A method is provided to manage playback of adaptive bitrate streaming video using using a stall time delay. The method includes pausing playback of a segment of a variant when a playback point reaches a download point, marking a stall time that marks a point in time in the segment at which playback was paused, determining a remaining playback time, determining a remaining download time, selecting an offset time, determining a wait time, determining a resume time, and waiting to resume playback at least until the download point reaches the resume time.