A method of and system for performing pilot testing of a software program in an organization is carried out by collecting pilot testing data generated from a pilot testing of a software program run on one or more hardware assets in the organization, determining whether a sufficient amount of pilot testing data has been collected, and, when so, calculating one or more pilot test metrics from the collected data. The calculated pilot test metrics may then be compared to similar metrics in a target population to evaluate the software program.