A method of grouping images captured in a common location, including receiving a collection of images; classifying the images into a set of events, where each image in the collection belongs to no more than one event; analyzing background region(s) of images from each event to determine one or more features that represent the event; and comparing features from at least two events to determine which events occurred in a common location.