A method by a media delivery system. The method includes generating a streaming manifest file and an auxiliary manifest file, where the streaming manifest file includes references to video segments of a video content, where the auxiliary manifest file includes timed metadata associated with the video content, and where the streaming manifest file and the auxiliary manifest file refer to a same timeline. The method further includes making the streaming manifest file and the auxiliary manifest file accessible to a client device.