A parallax calculating apparatus comprises first parallax calculating means for calculating a first parallax on a basis of a reference image for all pixels in the reference image using SGM method, second parallax calculating means for calculating a second parallax on a basis of the reference image for at least a part of pixels among pixels in the reference image using BM method, and final parallax calculating means for calculating a final parallax of each of pixels in the reference image based on the first and second parallaxes. The final parallax calculating means calculates the first parallax as the final parallax for a pixel for which only the first parallax has been calculated and calculates a parallax where a decimal part of the first parallax is replaced with that of the second parallax as the final parallax for a pixel for which the first and second parallaxes have been calculated.