An imaging element includes a plurality of photoelectric conversion units that output an image signal for each pixel through a micro lens. An imaging signal processing circuit separates image signals output from the imaging element into a left-eye image signal and a right-eye image signal. An image combining circuit generates combined image data by performing arithmetic average processing for left-eye image data and right-eye image data. A recording medium control I/F unit controls to record left-eye image data and right-eye image data for use in 3D display and combined image data for use in 2D display in different regions in an image file.