A set of user interface tools is described facilitating asynchronous adjudication of one or more regions-of-interest in a medical image by a group of two or more graders, each of which has access to the set of tools in a workstation environment. The set of tools include (1) a feature for enabling the graders to assess the medical image and manually delineate one or more specific regions-of-interest (ROI) in the medical image, (2) a feature for assessing the ROI(s) delineated by other graders, including display of the ROI delineated by other graders; (3) dialog features for explaining and discussing the assessments, including a text feature for discussing the assessments. The dialog features and the ROIs delineated by all the graders are visible to all the graders on the workstation display as they collectively adjudicate the medical image in a round-robin manner. The set of tools further include (4) a feature for manually verifying grader agreement with the other graders' assessments.