A system for testing a network-based application has a continuous integration (CI) service that performs CI testing of a server application that is being developed to support a client application, such as a client application that will be used on a wireless communication device. The CI service detects server source code changes and in response rebuilds the server application and deploys it to a test server. In addition, the client application is installed and executed on one or more wireless communication devices, so that the client application communicates with the test server using a wireless communications network. Tests of the client application are performed as it executes on the devices, and results are reported to the CI service. The CI service reports any errors that occurred during testing of either the server application or the client application.