A system and method for multimedia scene break detection, including: a computer processor, a scene break detection service executing on the computer processor and comprising functionality to: (i) receive a request for scene break detection on the media item, (ii) perform audio break detection on an audio component of the media item to obtain a set of audio break timestamps, (iii) identify a set of video break timestamps, each corresponding to at least one frame of a video component of the media item, (iv) identify a set of candidate scene break timestamps based on the audio break timestamps and the video break timestamps, (v) execute a computer vision scoring model for each candidate scene break timestamp, and (vi) select, based at least on a score of each of the set of candidate scene break timestamps, a final set of scene break timestamps for performing a media action.