Systems and methods for three-dimensional imaging and viewing are disclosed. A method for generating a three-dimensional image may include producing a pattern in a spatial light modulator based on data representative of an image of an object, illuminating the spatial light modulator so as to yield a projection beam, masking at least one portion of the projection beam such that a portion of the projection beam is selected, and propagating the selected portion to an exit pupil so as to form a virtual 3-D image of the object when viewed at the exit pupil. An apparatus may include a projector comprising a spatial light modulator array that modulates the phase of light to produce a phase modulated beam that is projected to a viewer thereby forming a 3-D image of the object when viewed by the viewer, and processing electronics configured to extract phase information from a signal.