Provided are an image processing apparatus and an image processing method, the image processing apparatus including: a parallax estimation unit which estimates parallax with respect to a left eye image and a right eye image of a three-dimensional (3D) image; a horizontal movement value determination unit which determines a horizontal movement value using the estimated parallax; a horizontal movement unit which horizontally moves the left eye image and the right eye image based on the horizontal movement value; and a controller which calculates a chronological change rate of the estimated parallax for a predetermined time, determines whether the chronological change rate is greater than a predetermined threshold, and if the chronological change rate is greater, limits the horizontal movement value to a predetermined range and controls the horizontal movement unit to horizontally move the left eye image and the right eye image based on the limited horizontal movement value.