Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for retrieving and using contextual data from previous conversation sessions in conversational searches. In one aspect, a method includes receiving a first query for a first user session, determining that the first query refers to one or more tags in a first repository, the first repository associating respective identifiers to respective tags, each identifier representing a corresponding user session, determining one or more particular identifiers associated with the one or more tags in the first repository, retrieving particular contextual data associated with the determined particular identifiers in a second repository, the second repository associating respective identifiers to respective contextual data associated with corresponding user sessions represented by the respective identifiers, and performing an action responsive to the first query based on the retrieved particular contextual data.