This invention describes remote management of end to end automated mobile application tests to be executed on the mobile devices that may be connected to network emulators or on live (real time) networks. Further, this invention relates to mobile data applications that need to connect to the packet data network over the radio network, and associated automated test systems and methods. Discloses is a method of having an end to end extraction of user actions, application behaviors, device state, and IP and radio layer messaging that can be centrally analyzed to understand the application impact on the network and device, as well as the application behavior for different network conditions.