A query segmentation system segments a search query into a query segment that identifies search results from items stored on a database. The query segmentation system receives a query string, and the query string comprises a plurality of tokens. A first token and a second token are identified from the plurality of tokens, and a first vector and a second vector associated with the first token and the second token respectively are determined. The query segmentation system determines whether to include the first and second tokens in a single query segment based on the first and second vectors. The single query segment is processed to identify the search results from the database.