A system and method is disclosed to reduce variation of the clinical decision making process when an image reporting and data system (IRADS) for medical diagnosis is used. Image reporting and data systems provide guidelines for an operator to identify images as belonging to one of a number of categories and specific clinical actions are then recommended based upon such categories. Some clinical actions such as biopsies may be recommended by IRADS even when they are not necessary. The present inventive concept is configured to utilize a Computer-Assisted Diagnosis (CAD) system that is specifically programmed to minimize discrepancies between the recommended clinical actions of an individual or specific group of experts using the standard IRADS process and the optimum clinical actions based on correlation with biopsy proven data. The resulting CAD system reduces the number of unnecessary clinical actions such as biopsies based on the operator's error profile.