A three-dimensional information augmented video see-through display device according to an exemplary embodiment of the present disclosure includes a camera interface module which obtains at least two real images from at least two camera modules, a rectification module which performs rectification on the at least two real images, a lens distortion correction module which corrects at least two composite images obtained by combining a virtual image to the at least two real images, based on a lens distortion compensation value indicating a value for compensating for a distortion of a wide angle lens for the at least two real images, and an image generation module which performs side-by-side image processing on the at least two composite images to generate a three-dimensional image for virtual reality VR or augmented reality AR.