Method and apparatus for summarizing video data is disclosed. In one embodiment, a method includes accessing face information that is associated with at least one identified person within frames of the video data, examining user specifications for selecting portions of the video data, comparing the user specifications with the face information to determine indicia of interest related to each of the frames, identifying at least one of the frames that are in accordance with user specifications based on the indicia of interest and forming summary video data using the at least one identified frame of the video data.