A focus adjustment device, comprising: a processor having a main physical object position detection circuit for detecting position of a main object based on an image signal, a distance value detection circuit for detecting distance values in accordance with object distance of a plurality of AF regions based on the image signal, a candidate region setting section for setting regions exhibiting a distance value for a close-range side of greater than a specific value, with respect to a statistic for distance value of regions corresponding to position of the main physical object, to unnecessary candidate regions, and a control section for determining regions corresponding to unnecessary physical objects based on the unnecessary candidate regions, and controlling focus adjustment based on distance value corresponding to regions that have had regions corresponding to the unnecessary physical objects excluded from the main physical object regions.