Methods and systems are described for allowing a user to quickly determine parts of a media item in which the user will be interested. In the methods and systems described, a timeline is provided for the media item and semantic icons are used as media landmarks along the timeline. The semantic icons are related to the content or a description of the content at the location in the media item corresponding to the semantic icon's location on the timeline. The semantic icons, in addition to providing some immediate contextual information at a glance, also allow a user access to annotations of the media item. Semantic icons can represent tags, users who have created or modified annotations for the segment of the media item, or other relevant information. The semantic icons may also be used to determine a relative level of interest in different parts of the media item both with respect to the user and with respect to other users.