A system, method and computer readable storage medium for generating a context driven summary view of medical findings by retrieving a current study including at least one image to be analyzed, extracting current context information from the current study and storing the current context information in a database and matching the current context information with prior context information from prior studies to return a set of relevant prior studies.