An active set of discrete texture traces to a target point is determined in a first video frame and is applied to a second video frame to detect the target location in a second video frame. An estimate is made of the target location in the second video frame. A score map is computed of an area of locations. A location with a highest score in the score map is the new target location. If a threshold value is not met the active set of texture traces is stored. A score map for each of stored active sets is computed to determine the target location. If no score meets the threshold the target location in a previous video frame is made the current target location and a new active set of discrete texture traces is determined. Systems that implement the steps of the methods are also provided.