Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for caching fragmented streaming media, e.g., for caching fragmented media documents streamed in accordance with HTTP, are described in this specification. In one aspect, a system including means for obtaining, locally, fragments of a media document from a remote media source based on a manifest that refers to storage locations where the fragments are stored at the remote media source. Further, the system includes means for generating index points into a locally cached media item of the obtained fragments, the generated index points being different from any index point of the manifest. Additionally, the system includes means for playing the locally cached media item based on the generated index points.