A label generating system operates to generate an artificial intelligence model by: training on a training data set that includes the plurality of medical scans with the corresponding global labels; generating testing global probability data by performing an inference function that utilizes the artificial intelligence model on the plurality of medical scans with the corresponding global labels, wherein the testing global probability data indicates a testing set of global probability values corresponding to the set of abnormality classes, and wherein each of the testing set of global probability values indicates a probability that a corresponding one of the set of abnormality classes is present in each of the plurality of medical scans with the corresponding global labels; comparing the testing set of global probability values to a corresponding confidence threshold for each of the plurality of medical scans selected based on the corresponding one of the global labels; generating an updated training data set by correcting ones of the plurality of medical scans having a corresponding one of the testing set of global probability values that compares unfavorably to the corresponding confidence threshold; and retraining the artificial intelligence model based on the updated training set.