In an embodiment, a computer-implemented process comprises accessing a plurality of digitally stored, unstructured medical diagnostic data; digitally displaying a first subset of the medical diagnostic data, the first subset of the medical diagnostic data including at least a first set of diagnostic reports, using a computer display device, concurrently with digitally displaying one or more quality control checklists that are specific to a medical discipline represented in the first set of diagnostic reports; receiving digital input specifying one or more errors in the first set of diagnostic reports and digitally storing the digital input in association with the first subset of medical diagnostic data; training a hierarchical Bayesian machine learning model using the digital input and the first subset of medical diagnostic data; evaluating the hierarchical Bayesian machine learning model, after training, for a second subset of the medical diagnostic data, the second subset being different from the first subset, to result in outputting one or more provider error rate data; applying a grading algorithm to the one or more provider error rate data to yield one or more output provider quality score values.