According to some embodiments, a method includes accessing a live track list stored in memory. Each track of the live track list includes a coordinate of an object of interest captured by a physical sensor located within a physical environment and a unique ID. The method further includes comparing a new track to the live track list in order to determine if the new track matches any existing tracks. The method further includes merging the new track with the particular existing track when the new track matches a particular track in the live track list. The method further includes adding the new track to the live track list when the new track does not match any existing tracks. The method further includes displaying a virtual 3D environment that corresponds to the physical environment. The method further includes projecting virtual objects into the virtual 3D environment using the live track list.