Systems and methods for transmission and display of synchronized physical and visual data for three-dimensional display are disclosed. Physical and visual data may be encoded and interlaced to enable synchronized transmission of the data in efficient manners. A single data transport stream may be utilized to transmit both physical and visual data over a communication channel, allowing physical and visual data to be efficiently co-joined on a same surface at a receiving end to provide a realistic, true three-dimensional representation.