A 3D video processing device includes a disparity map generator which compares a first-perspective image from a first perspective with a second-perspective image from a second perspective, which are two images forming stereoscopic video, thereby generates a disparity map which represents disparity of the second-perspective image with respect to the first-perspective image, a first new image generator which rotates the first-perspective image based on rotation angle information which represents rotation statuses of the first- and the second-perspective images, thereby generates a new first-perspective image, and a second new image generator which generates a new second-perspective image, which is paired with the new first-perspective image to form stereoscopic video, based on the first-perspective image and on the disparity map.