A three-dimensional (3D) display apparatus and method controlling thereof are provided. The 3D display apparatus includes: a reception unit which receives a 3D image signal from another 3D display apparatus; a conversion unit which converts a disparity of the 3D image signal based on transmitter information of the other 3D display apparatus and receiver information of the 3D display apparatus, and generates an output 3D image signal having depth information which is proportional to depth information of the 3D image signal; and a display unit which outputs the output 3D image signal.