An image processing apparatus which performs processing on an input moving image including a plurality of access units arranged every first period, includes a motion vector calculation unit which calculates a motion vector of an object included in the input moving image every second period, a motion vector conversion unit which, converts the motion vector by multiplying the calculated motion vector by a predetermined gain, a frame compensation unit which generates an output moving image including a plurality of access units arranged every third period by performing frame compensation processing of converting or compensating for the access units on the input moving image so that the object moves in accordance with the motion vector which has been subjected to the conversion, and a gain calculation unit which calculates the gain in accordance with brightness in a user environment and supplies the obtained gain to the motion vector conversion unit.