An image pickup apparatus includes an image-pickup lens having an aperture diaphragm, an image-pickup element that has a color filter which is periodically allocated colors in units of a predetermined unit array and that generates picked-up image data including pixel data of colors using received light, the color filter being adjacent to a light receiving surface, a microlens array unit that is arranged on an image forming surface of the image-pickup lens and whose microlenses are each allocated a plurality of pixels of the image-pickup element, and an image processing unit that performs image processing on the picked-up image data generated by the image-pickup element. The image processing unit includes a parallax component image generation unit that generates a plurality of parallax component images and an interpolation processing unit that performs color interpolation processing for each of the parallax component images.