An automatic playback overshoot correction system predicts the position in the program material where the user expects to be when the user stops the fast forward progression of the program material. The system determines the position where the program material was stopped and transitions to the new mode that the user selected, starting at the stopped position with an overshoot correction factor subtracted from it. The system uses a prediction method to correctly place the user within the program upon transition out of fast forward mode and determines if the speed of the fast forward mode and then automatically subtracts a time multiple to the frame where the transition was detected and positions the user at the correct frame. The time multiple is fine tuned if the user is consistently correcting after the fast forward mode stops.