Disclosed is a device for constructing image database, including: an image input unit for receiving an image; and a building identification unit configured to map the image to a three-dimensional map based on photographing information of the image, to project direction vectors toward respective locations of the image that are mapped to the three-dimensional map from a photographing position of the image, and to distinguish buildings from the image based on whether the respective direction vectors collide or not.