An image processing apparatus comprising: an image acquisition unit configured to acquire an image; a depth map acquisition unit configured to acquire a depth map corresponding to the image; a refinement unit configured to detect a saliency region from the image and to refine the depth map on the basis of the saliency region, the saliency region being a region on which a person tends to focus; and an image processing unit configured to apply image processing to the image using the depth map refined by the refinement unit.