A target object tracking device is provided. The device includes a memory for storing association information in which a selecting order of target objects is associated with symbols indicating the target objects, respectively, a starting selection accepting module for accepting a selection of the target objects to start tracking thereof, a symbol reading module for reading the symbols for the selected target objects corresponding to the selecting order of the target objects based on the association information, a tracking module for tracking the selected target objects, a symbol displaying module for displaying the symbols read by the symbol reading module, at positions where the target objects tracked by the tracking module are displayed, and a symbol changing module for changing, according to an operation of a user, the association information and displaying the symbols at the positions where the target objects are displayed, based on the changed association information.