The present invention provides a video surveillance system which tracks a tracking target by a plurality of surveillance cameras. This system is capable of tracking completely the location of the tracking target even in case the camera picture is automatically changed in accordance with the moving of the tracking target. The system includes a moving direction detector for detecting the moving direction of a tracking target. Moreover, the system has storage units for storing the passage configuration of a surveillance zone and the camera location information. The system also has a camera selector for identifying a camera which will shoot the tracking target next in accordance with the moving direction information, passage configuration information and camera location information, and a screen composition unit for synthesizing on a screen a picture from a camera shooting the tracking target and a picture from a camera selected by the camera selector.