The method and apparatus segment parts from a main target image, represent each part as a vertex in a spanning tree, use a detector to generate a confidence map of a location of each part in a succeeding video frame and apply scale change to detector sliding windows centered about each pixel in the part location image. In the succeeding video frame, the target location is sampled and a tracking probability is generated for each part bounding box, with the tracking probability having the maximum value being selected as the location of the target in the succeeding video frame.