Disclosed is a system (200) and method (101) for collaborative tracking of an object, the method comprising updating (105) the track with an object measurement using a camera tracking module (230), determining (110) a track quality measure for the updated track, based on the track quality measure, determining (120) whether a second tracking module (260), remotely located from the camera, should be applied, if the second tracking module (260) is to be applied, selecting (130) data describing the track and the object, transmitting (140) the selected data to the second tracking module over a network (240) that imposes constraints of bandwidth and/or latency, and applying (150) the second tracking module (260) to determine the next position of the object in the track.