Techniques are provided for automatically testing and verifying the functionality of push notification services of a cloud computing system. For example, a computing system performs an automated push notification test to test a push notification service of the computing system. The computing system sends a test push message over a communications network to a plurality of test devices that are located in different geolocations. The test devices are configured to automatically generate a response message in response to receiving the test push message. The computing system determines if a response message is received from each test device within a predefined response timeout period associated with the test device. The computing system determines that the push notification test fails in response to determining that a response message is not received from at least one test device within the predefined response timeout period associated with the at least one test device.