Techniques and systems are provided for segmenting one or more frames. For example, incremental optical flow maps can be determined between adjacent frames of a plurality of frames. Using the incremental optical flow maps, a cumulative optical flow map can be determined between a first frame of the plurality of frames and a last frame of the plurality of frames. A segmentation mask can be determined using the first frame of the plurality of frames. Foreground pixels of the segmentation mask for the last frame of the plurality of frames can then be adjusted relative to corresponding foreground pixels for the first frame. The foreground pixels can be adjusted using the cumulative optical flow map between the first frame and the last frame of the plurality of frames.