Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for implementing a network feature tester are disclosed. In one aspect, a method includes the actions of selecting computing devices that are configured to communicate with a wireless carrier network based on the computing devices having a common characteristic. The actions further include identifying a subset of the computing devices that are likely to communicate with a same base station of the wireless carrier network during a first period of time and a second period of time. The actions further include determining first monitoring data during the first period of time. The actions further include adjusting a characteristic of the same base station. The actions further include determining second monitoring data during the second period of time. The actions further include determining an effect that adjusting the characteristic has on the wireless carrier network.