A tracing device and a tracing method for realizing a real-time trace of a moving object such as a person from a time-varying image by method of a light processing load, and for learning features through the trace thereby to realize a trace of higher precision. The tracing device divides time-varying data inputted into partial images (in a strip or rectangle shape), and compares the background image containing no tracing object thereby with the current image thereby to extract the divided image having the tracing object. In order to discriminate the tracing object, moreover, the tracing device calculates the color high-level local self-correlated data, from which the features of color and shape can be extracted all at once, and performs the discrimination on the basis of a distance from the featuring data of the tracing object registered. The tracing device updates the background image and the registered featuring data into the latest ones. The features are acquired while tracing the tracing object, and the object is discriminated by utilizing the features so that a strong and highly precise trace can be realized.