A method and device for optimal playback positioning in video content are provided. The present disclosure relates to a mechanism of tagging scenes or significant points in content in a prioritized way, and defines a mechanism to utilize this tagging associated with the content to facilitate stopping or starting at appropriate points for playback, e.g., when pressing a scene skip button to jump forward or back to another scene, or when pressing Play after inputting a fast-forward or rewind instruction. The method and device provide for displaying video content at a playback speed for viewing, receiving a first navigation instruction to navigate the video content at a speed faster than the playback speed for viewing, receiving a second navigation instruction to displaying of the video content, and determining a playback position of the video content based on at least one tagged frame of the video content.