An object tracking system and method operable to minimize processing time for tracking objects is provided. The system includes a pair of filters operable to make associations between dynamic objects newly detected and previously detected. One of the pair of filters makes an association when the predicted location of the previously detected objects is within a predetermined distance of the newly detected object. The other of the pair of filters makes an association based upon the probability that a newly detected dynamic object is a previously detected dynamic object. The remaining unassociated dynamic objects are then localized so as to form discrete matrices for optimization filters.