A method for video insertion using backpropagation may include determining a first camera model from a first frame of the sequence. The method may also include determining a transition location. The method may further include generating a transform model based on an analysis of the first frame and a second frame that occurs earlier in the video sequence and applying the transform model to the first camera model to generate a second camera model for the second frame. The method then includes inserting an insertion into one or more frames earlier in the sequence between the second frame and the transition location based on the second camera model, wherein the inserting is performed before displaying the frames. A system for video insertion using backpropagation includes search, transition, track and insertion subsystems.