Systems and related methods for detecting a scene in video content are provided. In one example, a scene detection program identifies a plurality of shots in the video content and selects a target shot. The program builds a forward window including the target shot and having shots that are temporally ahead of the target shot, and a rearward window having shots that are temporally behind the target shot. For each of the shots in the forward window the program determines a dissimilarity between a selected shot in forward window and each of the other shots in the rearward window. If one or more of the dissimilarities is less than a scene boundary threshold, the program determines that the scene does not begin at the target shot. If none of the dissimilarities is less than the scene boundary threshold, the program determines that the scene begins at the target shot.