Provided is a multi-dimensional layered modulation transmitting and receiving apparatus and method for stereoscopic three-dimensional (3D) video data. The transmitting apparatus may convert multi-dimensional data to a plurality of stream data by mapping the multi-dimensional data to a complex number plane, and may transmit the plurality of stream data by mapping the plurality of stream data to dimensions divided based on a time and a space, respectively. The receiving apparatus may determine a signal strength of received signal, a performance, a power mode, may determine a service image corresponding to the signal strength, the performance, the power mode, may determine a dimension corresponding to the service image, and may receive stream data of the determined dimension.