The present invention relates to a video analysis system for an energy-consuming building equipment. The video analysis system includes a camera and an image processing unit to monitor people who appear in a target region, and in an actual space where the camera coexists with the energy-consuming building equipment, a height from the camera to a bottom surface of the actual space ranges from 2 to 10 meters. The present invention further relates to an intelligent building management system provided with the video analysis system for the energy-consuming building equipment. With the video analysis system of the present invention, a security system of a building is combined with the energy-consuming building equipment by means of an optimal camera design/arrangement, which can improve the operation efficiency of the whole building significantly and achieve a desirable energy-saving effect.