A method of harvesting lesion annotations includes conditioning a lesion proposal generator (LPG) based on a first two-dimensional (2D) image set to obtain a conditioned LPG, including adding lesion annotations to the first 2D image set to obtain a revised first 2D image set, forming a three-dimensional (3D) composite image according to the revised first 2D image set, reducing false-positive lesion annotations from the revised first 2D image set according to the 3D composite image to obtain a second-revised first 2D image set, and feeding the second-revised first 2D image set to the LPG to obtain the conditioned LPG, and applying the conditioned LPG to a second 2D image set different than the first 2D image set to harvest lesion annotations.