A compensation allocation unit performs allocation compensation of a motion vector to a pixel to which a motion vector is not allocated by a victor allocation unit. A C/UC area determination unit compares magnitudes of a present DFD, a past DFD, and a future DFD based on a background vector and a DFD based on a compensation allocation vector by an evaluation value calculation unit to determine an area of a target pixel. Regarding the target pixel determined as the pixel in a covered area or an uncovered area, an interpolation method decision unit decides a computation method for a pixel value through which one of a double-sided interpolation and a one-sided interpolation. An interpolation frame generation unit computes the target pixel of the pixel value of the interpolation frame through the method decided by the interpolation method decision unit.