A method and apparatus of a device that measures performance of a plurality of cloud service providers is described. In an exemplary embodiment, the device deploys a plurality of cloud agents to the plurality of cloud service providers. In addition, the device configures a controller to measure the performance of each of the plurality of cloud service providers using each plurality of cloud agents. The device further probes each of the plurality of cloud service providers by sending probe data to each of the plurality of cloud service providers. The device additionally receives response data from each of plurality of cloud agents, wherein the response data is indicative of performance measurements of the plurality of cloud service providers. Furthermore, the device measures the performance for each of the plurality of cloud service providers using the response data.