A visual refinement interface enables users to adjust and/or refine search results by selecting results that match a user's interest, and displaying subsequent results that are closer to the selected items. Multiple result sets can be displayed concurrently such that the user can maintain context for the results. Further, the user can quickly go back to modify an earlier selection without having to navigate to a previous page, for example, and a single modification can cause several subsequent result sets to automatically change such that the user can quickly view dozens of new results, for example, simply by selecting at least one different result from a displayed result set. Prior result sets can be modified, such as by reducing the size or adjusting the placement of the sets, such that the user can easily determine the current set and the relatedness to previous results sets.