Systems and methods for providing fast forwarding recommendations based on the user's consumption history are disclosed. The consumption history includes data relating to attributes that were previously rewinded and watched and those that were skipped and forwarded. It also includes scores for attributes that were present and absent in a portion that was previously rewinded or forwarded. A score is assigned to the attributes and used for determining a consumption pattern. If the consumption pattern indicates that the user previously rewinded and watched the attribute, then a recommendation not to skip an upcoming portion that includes the attribute is provided. A graphical timeline that depicts the amount of time saved by skipping the portion of the media asset with the attribute is also provided.