A video surveillance method and a video surveillance system applied the method are provided. The method includes capturing an image of at least a part of a monitored area to obtain a plurality of video streams; sensing the monitored area to obtain a plurality of sensing data; if an image of an object of a video stream is determined as a target object, determining whether the target object triggers a target event according to one of the sensing data corresponding to the video stream; if the target object is determined as triggering the target event, outputting a feature value corresponding to the target object according to a preset analysis condition, the video stream including the target object and the target event; and generating a notification event corresponding to the target object according to the feature value and a model weight value corresponding to the target object.