A method and system for contextual browsing of videos that are relevant to a current video. Browsing controls that include labels and previews are presented in a user interface. The labels represent sets of videos that are organized according to their relevancy to a current video. The previews represent videos from a set of videos that is currently in focus. If the user switches focus from one set of videos to another set of videos, the previews are updated to correspond to the videos in the second set of videos. The user can also browse through the previews in order to select another video for playback.