Systems and methods for rewinding a video to a point before the video was first viewed. Video transmitted by a media source is cached by a remote server. Upon a trick-play request for the video, the server generates a rewind stream that includes the video that was transmitted by the media source before the user started to view the video. Upon receiving the rewind stream, the user's equipment may cache the rewind stream in a rewind buffer and rewind or play from the rewind buffer. The server may also generate and transmit a forward stream of the video that the media source has not yet transmitted. The user's equipment may cache the forward stream in a forward buffer. To perform trick-play operations with the video, the user's equipment may migrate the playback of the video to the rewind and forward buffers and rewind or fast-forward the video from the buffers.