An image pickup apparatus includes: an image pickup lens; an image pickup device; a microlens array; an image processing section; and a data storage section, in which the image processing section produces a plurality of arbitrary viewpoint images based on image pickup data obtained by the image pickup device by synthesizing pixel data extracted from pixels located at the same position in image regions each of which corresponds to each of microlenses included in the microlens array, and the arbitrary viewpoint images are stored in the data storage section, and a plurality of pixel data recorded at pixel positions adjacent to one another are collectively read out as a read-out unit from each of the arbitrary viewpoint images stored in the data storage section, and a predetermined sorting process and a predetermined integration process are performed on the pixel data read out, thereby the refocus image is produced.