An image processing apparatus, comprising a generation unit configured to generate a three-dimensional shape model of an object present in a field, based on a plurality of captured images obtained by a plurality of cameras that capture the field from different directions, a specification unit configured to specify a direction of the three-dimensional shape model generated by the generation unit, and a storage control unit configured to cause the direction of the three-dimensional shape model specified by the specification unit to be stored in a storage unit together with identification information of the object.