An image pickup apparatus determines from which position in a plurality of photographed frames a pixel of each of lines of an image to be output is read out, on the basis of a motion amount at a photographing time of each of the lines of a photographed predetermined frame, and if the determined read-out position is located on the outside of a photographing range of the predetermined frame, then determines to read out a pixel in a frame photographed before and/or after a photographing of the predetermine frame as the pixel of the output image and calculates a read-out position of the pixel on the basis of the motion amount at a photographing time of each of the lines in the frame.