An apparatus and method are described for displaying images to a user. The apparatus may include a display configured to display a three-dimensional (3D) image and a pointer in correspondence with movement of a remote controller. The apparatus may further include an interface and a controller. The interface may be configured to provide a shift input for moving the pointer in correspondence with movement of the remote controller, and receive a depth change input for changing a depth value of an object displayed within a reference distance from an area to which the pointer has moved. The controller may be configured to extract a depth value of the object and change the depth value according to the depth change input to control display of a 3D image based on the changed depth value.