A mechanism is provided to implement an artificial intelligence (AI) based alert mechanism system for alerting a medical professional of potential inaccuracies in medical image analysis. Responsive to receiving a medical image of a patient and a radiology report associated with the medical image, the AI based alert mechanism analyzes the radiology report to identify medical findings detected by the medical professional and analyzes the medical image to detect one or more medical findings associated with the medical image. Responsive to the AI based alert mechanism identifying one or more medical findings, the AI based alert mechanism compares the identified medical findings to those medical findings identified in the radiology report. Responsive to the AI based alert mechanism identifying a discrepancy between the identified medical findings to those in the radiology report, the AI based alert mechanism generates an alert to the medical professional who generated the radiology report.