A system and method is disclosed for automated analysis of an automated medical diagnostic process. The system is comprised of a computing device, storage, and diagnostic analysis module configured to observe an automated medical diagnostic process from an initial patient contact to a final result of the disease for which a diagnosis and treatment is desired. In operation, the system receives diagnosis input from a plurality of automated medical diagnostic processes, the treatment advice given to a patient during the period, and the final result of the disease. Based on these inputs, the system determines a level of accuracy of the automated medical diagnostic process for possible follow on use to improve such accuracy.