Methods and systems are provided for enabling the creation, game play, and third party view of a head-to-head challenge game played synchronously or asynchronously by a first and second player. In one embodiment, a method includes operations for receiving a request to view the challenge game for obtaining a first and second video associated with a predefined segment of a single player game as played by the first and second player. The method further includes operations for executing the challenge game that plays the first video alongside the second video in a spectator interface, for accessing and processing telemetry data of the game play of the predefined segment to generate modified game play metrics, and for replacing game states that were produced when the predefined segment of the game was played with the modified game play metrics. The modified game play metrics are rendered to the spectator interface.