A holographic display apparatus capable of steering a location of a viewing window according to a location of an observer is disclosed. The holographic display apparatus includes a light source; a spatial light modulator configured to modulate incident light and thereby reproduce the holographic image; a spatial filter configured to transmit only the holographic image; an eye tracker configured to track a pupil location of an observer; and a controller configured to adjust locations of the light source and the spatial filter in response to a change in the pupil location of the observer received from the eye tracker. The controller is configured to move the light source and the spatial filter simultaneously in the same direction by the same distance.