A stereoscopic endoscope system includes: a corresponding point detection section that detects a position of an object in each of an image for the right eye and an image for the left eye based on right and left video signals; a horizontal position moving section that moves, based on a parallax between the image for the right eye and the image for the left eye and depth information of a stereoscopic video which are obtained from the detected positions, horizontal positions of the right and left video signals, by an amount of the parallax, respectively in directions determined according to the depth information; a vertical/horizontal inversion section that vertically and horizontally inverts the right and left video signals whose horizontal positions have been moved; and a stereoscopic signal combining section that combines the right and left video signals subjected to the vertical/horizontal inversion, and generates a stereoscopic video signal.