An image processing apparatus comprises a storage unit configured to store feature information of a predetermined object, a determination unit configured to detect feature information of an object from an image to be searched and determine a similarity to the feature information of the predetermined object stored in the storage unit, a search unit configured to search a candidate image containing the predetermined object as a result of the determination by the determination unit, and a control unit configured to control, based on attribute information associated with image-shooting conditions, the order in which images are subjected to the determination processing by the determination unit.