A system for generating a report based on image data is disclosed. A template selector (1) selecting a template from a plurality of templates, the template defining a structure for the report and data fields to be filled in for the report, wherein the template further defines associations between data fields and view descriptors, wherein a view descriptor defines an image type and a presentation mode of the image type. A data field presenter (2) presenting a representation of the data fields of the template to a user. An image dataset selector (4) automatically selecting at least one image dataset having the image type defined by the view descriptor associated with the selected at least one data field. A view generator (5) automatically generating a view of the at least one selected image dataset based on the presentation mode defined by the view descriptor associated with the selected at least one data field. A report generator (7) for generating the report based on the template and the data provided by the user.