An information processing apparatus acquires an image by imaging an imaging apparatus, detects an occurrence of a factor that influences a position and orientation estimation relating to an image, determines whether or not to register the acquired image based on the detected factor, and constructs an image database for estimating the position and orientation of the imaging apparatus from the image acquired by the acquisition unit using a group of images determined to be registered.