Disclosed herein are system, apparatus, article of manufacture, method, and/or computer program product embodiments for selection of video segments for adaptive streaming. An embodiment operates by receiving one or more variant segments, the one or more variant segments including an old bitrate variant segment having an old bitrate and a new bitrate variant segment having a new bitrate for decoding and playback. The embodiment further operates by generating an old bitrate packetized elementary stream (PES) collection based on the old bitrate variant segment and a new bitrate PES collection based on the new bitrate variant segment and determining a first in-tolerance splicing location between the old bitrate PES collection and the new bitrate PES collection based on a maximum tolerance offset. The embodiment still further operates by splicing the old bitrate PES collection and the new bitrate PES collection based on the first in-tolerance splicing location.