Searching for items, such as apparel items, can be performed using a set of category-specific outlines or contours from which a user can select. The outlines enable a user to quickly specify a relevant category, and provide guidance as to how to orient the camera in order to enable an item to be identified in an image without the need for an expensive object identification and segmentation process. The outline can specify a “swatch” region, indicating where the user should position a view of a pattern, texture, or color of the item in which the user is interested. The category selection and swatch region data can be used to determine matching items. If the user wants a different set of search results, the user can select a different outline, causing a new query to be executed with updated category information and swatch data to obtain new search results.