Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for setting ad breakpoints in a video. The program and method provide for accessing a video; determining plural shot boundaries for the video, each shot boundary defining a shot corresponding to a contiguous sequence of video frames that is free of cuts or transitions; and for each shot boundary of the plural shot boundaries, performing a set of breakpoint tests on the shot boundary, each breakpoint test configured to return a respective score indicating whether the shot boundary corresponds to a breakpoint for potential insertion of an ad during playback of the video, calculating a combined score for the shot boundary based on combining the each of the respective scores, and setting, in a case where the combined score meets a threshold value, the shot boundary as the breakpoint.