The line buffer stores an input image after a change is made to the stored line position of each horizontal segment. The stored-line position memory unit stores the stored line position of each horizontal segment in the line buffer. The vertical interpolator performs vertical interpolation on each of outputs of the line buffer based on the differences between the vertical interpolation line positions and the stored line positions. Thus, the number of lines needed for vertical interpolation to be stored in the line buffer can be reduced.