Certain embodiments involve ranking search results from an information retrieval system using user query data to provide relevant search results to users of the information retrieval system. For example, a system determines a weight factor associated with a first user that provides a query to the information retrieval system based on a type or role of the first user. The system further determines a boost factor associated with the first user based on the weight factor and a number of consecutive search queries provided by the user. The system uses the boost factor to automatically tune a ranking algorithm to adjust a rank of a search result item resulting from a search query provided by a second user.