A passenger tracking system includes a multiple of sensors for capturing depth map data of objects. A processing module in communication with the multiple of sensors to receive the depth map data, the processing module uses the depth map data to track an object and calculate passenger data associated with the tracked object to generate a passenger tracking list that tracks each individual passenger in the passenger data from an origin lobby to a destination lobby and through an in-car track between the origin lobby and the destination lobby.