Methods, systems, and computer program products for using a confidence measure to automatically identify a diagnostic analyzer that applies to a diagnostic artifact. A plurality of diagnostic analyzers are each configured to analyze diagnostic artifacts relating to prior executions of software entities. A confidence measure is calculated for each diagnostic analyzer. Each confidence measure indicates a likelihood that the diagnostic analyzer applies to a particular diagnostic artifact. Calculating each confidence measure comprises applying one or more heuristics specific to the diagnostic analyzer against the particular diagnostic artifact, with an outcome of application of each heuristic contributing to the confidence measure for the respective diagnostic analyzer. Based at least on calculating the confidence measure for each diagnostic analyzer, and based on one or more determined thresholds, it is determined whether to include each diagnostic analyzers in a set of diagnostic analyzers with which to analyze the particular diagnostic artifact.