A tracking device includes feature information detection means for detecting feature information from a photographic image and tracking object matching means for comparing the feature information with tracking object information in which feature information of a plurality of figures are registered so that the feature information corresponds to a priority indicating tracking order of the feature information and for determining whether or not the feature information is information of the tracking object. The tracking device also includes priority acquisition means for acquiring the priority of the feature information detected from the tracking object information where it is determined that the feature information detected is the information of the tracking object and control means for controlling the photographing section, based on the priority acquired, so as to continuously include, in the photographic image from which the feature information is detected, feature information that has a highest priority in the photographic image.