A video imaging system, and more particularly, a modular video imaging system having a control module connectable to multiple input modules. The input modules each capable of receiving differing types of image data from different types of cameras including stereoscopic camera configurations and processing the image data into a format recognizable by the control module. The control unit providing general functions such as user interface and general image processing that is not camera specific including the generation of a 3D image stream formed by combining two image streams.