A depth calculation device for calculating depth information on an object from captured first image and second image with different blur, the depth calculation device comprising: an extraction unit configured to extract a first frequency component and a second frequency component from each of the first image and the second image, the first frequency component being a component of a first frequency band, the second frequency component being a component of a second frequency band, the second frequency band being lower than the first frequency band; and a depth calculation unit configured to calculate the depth information from the frequency components extracted by the extraction unit.