An image processing apparatus includes a first acquisition unit configured to acquire positional information indicating a photographing position of an image, a second acquisition unit configured to acquire photographic information on photographing of the image, a determination unit configured to determine reliability which indicates a level of the positional information acquired by the first acquisition means indicating a photographing position of contents expressed by the image based on the photographic information acquired by the second acquisition means, and an associating unit configured to associate the reliability determined by the determination means with the image.