A method enables testing and evaluation of an expert human reviewer or an artificial intelligence (AI) error detection engine associated with a radiotherapy treatment planning process. Intentional errors are introduced into the output of a software module or AI engine that performs a certain step in the radiotherapy treatment planning process. The efficacy of the human or AI reviewer in detecting errors can then be evaluated or tested by determining whether the human or AI reviewer has detected the introduced error.