An information processing apparatus has a hold unit for holding a plurality of features of a physical space as a plurality of held features, each of the plurality of held features being related with a position in a first image captured by an image capturing apparatus at a first time, and information of an availability for a position/orientation calculation of the image capturing apparatus. The information processing apparatus associates a plurality of detected features, which are detected in a second image captured by the image capturing apparatus at a second time after the first time, with the plurality of held features, and, based on the availabilities related with the associated held features, adjusts a detected feature, among the plurality of detected features, to be used in the calculation of the position/orientation of the image capturing apparatus.