An image processing apparatus includes: motion vector detection section configured to detect a motion vector of each of a plurality of blocks of a predetermined size set in an image and formed from a plurality of pixels; and global motion calculation section configured to carry out convergence mathematical operation, from the motion vectors of the blocks detected by the motion vector detection section, using extended affine transformation in which at least one of affine parameters is represented by a function of a variable regarding a displacement axis of the image to calculate a global motion representative of deformation applied to the entire image.