A video may include a capture of a scene, such as a wide-field of view capture of the scene. A punchout of the video may provide a framing of the captured scene. The punchout may be determined based on the context of the video, such as the type of captured scene within the video, the motion of the image capture device that captured the video, and/or the motion of one or more things within the captured scene.