There is provided an image processing apparatus including a first polarizing unit that has a first polarization region and a second polarization region to transmit different polarized light corresponding to different viewing point images, a second polarizing unit that includes a third polarization region to transmit only transmission light of the first polarization region, a fourth polarization region to transmit only transmission light of the second polarization region, and a total transmission region to transmit the total transmission light of the first polarization region and the second polarization region, an imaging element, and an image processing unit that executes signal processing with respect to an output signal of the imaging element. The image processing unit executes correction processing to generate a two-dimensional image and executes image conversion of the two-dimensional image to generate a left eye image and a right eye image for three-dimensional image display.