Techniques for calculating a test confidence metric (TCM) are disclosed. Calculating the TCM involves obtaining test results of a testing application. Calculating the TCM is based on confidence scores corresponding respectively to the test results. Calculate a confidence score for a particular test result involves identifying a failure reason for the test result, determining a weight corresponding to the failure reason, and calculating the confidence score based on the weight.