A holographic display device with reduced color shifting in relation to different colors includes a display panel and a diffraction component. The display panel emits a first color light having a first emission efficiency and a second color light having a second emission efficiency. The first emission efficiency is greater than the second emission efficiency. The diffraction component on an optical path of the first and second colors of light diffracts the first color light at a first diffraction efficiency and the second color light at a second diffraction efficiency to generate a holographic image, the first diffraction efficiency is less than the second diffraction efficiency.