A computer-implemented method is provided, including receiving a search query from a user during a search session, and presenting information to the user responsively to the search query. After an indication that the user takes an action related to the search session is received, a portion of the presented information is identified that the user did not select prior to taking the action, and respective scores are assigned to search results generated responsively to the search query, including lowering one or more of the scores of the respective search results that are characterized by the non-selected portion of the presented information. The search results are ranked according to the scores, and presented to the user. Other embodiments are also described.