Determining an amount of motion in a second frame of video with reference to a first frame of video. Adaptively predicting a cropping factor for the second frame in response to the determined amount of motion. The cropping factor specifies a portion of the second frame that is to be excluded from the second frame. The predicted cropping factor is adaptively changed for a successive plurality of frames by buffering the first frame to predict a desired cropping factor for the second frame, wherein the first frame occurs prior to the second frame.