An image retrieval apparatus includes a designation unit configured to designate a query area of an image based on a user's designation operation, a display unit configured to display an area where a local feature amount is difficult to be extracted in the query area designated by the designation unit as a feature non-extractable area, and a retrieval unit configured to retrieve, based on a local feature amount extracted from an area which is not displayed as the feature non-extractable area in the query area by the display unit, image feature data with which a local feature amount and the image are associated and which is stored in a storage device.