An information retrieval system for scientific literature provides a summary document for reviewing the results of a query that provides both a text-based summary and an image-based summary, the latter represented by a figure from the document that has a highest ranking indicating its centrality to the concept of the document. A ranking of figures may be done by an analysis of figure-associated text either by supervised machine learning or comparison of text similarities.