Typical users may be interested in viewing photos of people with whom they maintain true social contact. In one example, a person's true social network may be inferred from photo tagging history. Social contacts tend to tag each other in photos, while other types of contacts (e.g., business contacts) are less likely to tag each other in photos. Thus, in order to determine what photos to show to a given user, people may be scored based on how often the user has tagged those people in photos, and also on how often those other people have tagged the user. Those people who have high scores may be presumed to be socially close to the given user. Photos containing people who have received high scores may be selected, and the selected photos may be shown to the user.