Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for identifying an image for an entity. In one aspect, a method includes identifying a set of resources. Each resource can include at least one image and reference at least one entity. Each image is assigned to a particular entity based on an overall entity scores for the image relative to the entities. The overall entity score for an image and an entity can specify a measure of topical relatedness between the image and the entity. For each individual entity referenced by at least one of the resources, a group of images that have been assigned to the individual entity is identified. An image evocative of each individual entity is selected from the group based on image rank scores. The image rank score for an image can be determined based on visual characteristics of the image.