The present technique relates to an image processing apparatus, an image processing method, and a program capable of obtaining a vector with a high degree of prediction accuracy as a prediction vector. A prediction vector generation unit generates a prediction vector of a deviation vector representing deviation of a target block, which is a processing target in a depth image having depth information about parallax as a pixel value for each pixel of a color image, with respect to another picture different from a picture of the target block. The prediction vector generation unit generates the prediction vector in accordance with a vector prediction method which is different depending on whether the target block is an occlusion block including an occlusion portion that does not include any corresponding point in another picture. The present invention can be applied to, for example, a case of generating a prediction vector of a parallax vector used to generate a prediction image for encoding and decoding of a depth image about parallax.