An image processing device including an image sequence acquisition section that acquires an image sequence that includes a plurality of images; and a processing section that performs an image summarization process that deletes some of the plurality of images included in the image sequence acquired by the image sequence acquisition section to acquire a summary image sequence. The processing section detecting a scene change from the image sequence, setting a partial image sequence that includes images among the plurality of images included in the image sequence based on the detected scene change, selecting a reference image and a determination target image from the partial image sequence, and determining whether or not the determination target image can be deleted based on deformation information about the reference image and the determination target image.