Embodiments described herein include systems and methods for automatically creating compilation videos from an original video based on metadata associated with the original video. For example, a method for creating a compilation video may include determining a relevance score for video frames in an original video; selecting a plurality of relevant video frames from the original video based on the relevance score; selecting a plurality of video clips from the original video based on the relevance scores of the video frames; and creating a compilation video from the plurality of video clips. Each of the plurality of video clips, for example, may include at least one relevant video frame from the plurality of relevant video frames.