The present disclosure provides a system and method for generating a video synopsis. The method may include obtaining a video captured by a movable camera at a plurality of positions, the video including a sequence of video frames; determining, for each of at least part of the sequence of video frames, a position label of the video frame that indicates one of the plurality of positions of the movable camera; classifying the at least part of the sequence of video frames into a plurality of groups based on their position labels; determining one or more objects of interest in at least one of the plurality of groups; generating, for the at least one of the plurality of groups, a video synopsis based on the one or more objects of interest.