In a method and system for populating multi-segment layouts with related multimodal medical images, a relationship is determined between subsets of the multimodal medical images. The relationship is used to determine selected subsets initially selected for display in respective segments of a segmented display. Appropriate images relating to selected subsets are used to populate the remaining display segments.