An image display device includes a first light modulation device including a plurality of display pixels, a lighting unit including a plurality of light adjusting elements, an illumination distribution storage unit that stores an illumination range information, a light adjusting information determination unit that determines light adjusting information for controlling the light adjusting elements of the lighting unit, and a shift information acquisition unit that acquires information of a position shift between the first light modulation device and the lighting unit. The light adjusting information determination unit modifies the illumination range based on the position shift information acquired by the shift information acquisition unit, and determines the light adjusting information based on the feature quantity of the first image information corresponding to display pixels in the modified illumination range.