Pseudo three dimensional image data sets are generated by an imaging apparatus, such as a digital camera having face detecting functions, by a simple operation. Reference image data sets, which are employed to generate pseudo three dimensional images, are generated from first image data sets, which are recorded. When new faces are detected by a face detecting section, correlative values between through the lens image data sets that include the new faces and the reference image data sets are calculated. When the calculated correlative values are greater than a predetermined value, pseudo three dimensional images are generated from the recorded first image data sets and newly obtained second image data sets that include the new faces.