An image display device includes a display panel displaying an image, and a diffractive element formed to operate in a 2D mode or a 3D mode so that the image of the display panel is perceived as a 2D image or a 3D image after passing through the diffractive element. In the image display device, the diffractive element includes a first substrate and a second substrate facing each other, a first electrode layer formed on the first substrate that includes a plurality of zones, a second electrode layer formed on the second substrate, and a liquid crystal layer interposed between the first substrate and the second substrate. Further, when the diffractive element operates in the 3D mode, a common voltage is applied to the second electrode layer, and polarity of voltages applied to the first electrode layer with respect to the common voltage is inverted every zone.