The present invention generally relates to a video control system, more particularly to a video control system, a display system control device and a video controlling method thereof. The video control system comprises a display system control device for processing all signals in the system and a display device assembly, which is composed of at least one and above intellectual display devices having independent addresses each, which are from 1A to M×N. The display system control device comprises a video bridge, which further comprises at least a video bridge unit, a video switch, an embedded micro-processing module and a storage device. The video controlling method comprises the steps of transmitting video inputs to respective video bridge units, which convert the video inputs to the video format of a video switch and outputting the converted video signals to the video switch; enabling the video switch to receive the video signals and output video output stream to the display device assembly. The video bridge and the video switch of the present invention are applied to adjust the ways of providing video sources, enabling the display device assembly to perform more flexibly and efficiently; the present invention further reduces the whole system and maintenance costs.