A distance image generation device includes a light projection unit for projecting reference light onto a subject, a light reception unit having a plurality of two-dimensionally arrayed pixels, an optical system for guiding light from the subject to the light reception unit, an influence calculation means for calculating, based on an amount of light received by a target pixel and peripheral pixels thereof among the plurality of pixels, an influence of optical phenomena on the target pixel and the peripheral pixels, an impact calculation means for calculating the impact exerted by the peripheral pixels on the target pixel based on the influence, and a distance image generation means for generating a distance image of the subject based on the impact.