Implementations generally relate to ranking and selecting images for display from a set of images. In some implementations, a computer-implemented method includes providing selected images for display, including examining characteristics of a plurality of images, where the examined characteristics include two or more of: visual capture characteristics, visual content characteristics, and social popularity characteristics of the images. The method determines individual scores for the respective examined characteristics of the images, determines overall scores of the images based on a combination of the individual scores for the examined characteristics of the images, and determines a ranking of the images based on the overall scores. The method selects one or more images based on the ranking of the images, and causes a display of the one or more selected images.