Methods and systems for automatic video summary generation are disclosed. A method includes: extracting, by a computing device, a plurality of frames from a video; determining, by the computing device, for each of the plurality of extracted frames, features in the frame; creating, by the computing device, a scene detection model using the determined features for each of the plurality of extracted frames; scoring, by the computing device, each of the plurality of extracted frames using the created scene detection model; and generating, by the computing device, a video summary using the scored plurality of extracted frames.