An image processing apparatus calculates the distance in a depth direction of an object in an image by using a plurality of images whose blur amount is different. The image processing apparatus has: an acquisition unit configured to acquire distance range information for designating a range of a distance to be calculated; a determination unit configured to determine a photographing condition of each of images photographed, on the basis of the distance range information; and a calculation unit configured to calculate the distance by using a plurality of images photographed in the respective photographing conditions determined by the determination unit.