An image diagnosis support apparatus includes: an acquisition unit that acquires a plurality of first image data groups and a plurality of second image data groups to be subjected to comparative interpretation; an association unit that associates each of the plurality of first image data groups and each of the plurality of second image data groups with each other based on a degree of similarity between the image data groups; an image extraction unit that extracts a corresponding image corresponding to at least one target image of the first image data group from a second image data group among the plurality of second image data groups associated with a first image data group among the plurality of first image data groups; and a display controller that displays a set of images of the target image and the corresponding image on a display unit in a contrastable layout.