A system and method of operating a vehicle. The system includes a two-dimensional imager, a three-dimensional imager, and at least one processor. The two-dimensional imager obtains a two-dimensional image of an environment surrounding the vehicle, wherein the environment includes an object. The three-dimensional imager obtains a three-dimensional (3D) point cloud of the environment. The at least one processor identifies the object from the 2D image and assigns the identification of the object to a selected point of the 3D point cloud.