A method for storing a video summary for a digital video sequence captured with a digital video capture device, comprising: capturing a digital video sequence with the digital video capture device, wherein the digital video sequence includes a plurality of video frames; storing the digital video sequence in a processor-accessible memory; identifying one or more key video snippets, each key video snippet corresponding to a set of video frames from the stored digital video sequence; assembling the key video snippets to form a video summary; and storing the video summary in a processor-accessible memory by storing metadata associated with the stored digital video sequence, wherein the metadata provides an indication of the video frames corresponding to the video summary.