A system automatically identifies objects in an environment based on a walkthrough video and an annotated floorplan of the environment. The annotated floorplan indicates locations and types of objects that are expected to be in the environment. The system receives the walkthrough video and generates a 3D model of the environment. The system applies a machine learning model to the walkthrough video to identify regions within frames where objects are captured. After identifying the regions within frames of the walkthrough video that include objects, the system modifies corresponding regions of the 3D model to include the identified objects. For each of the identified objects, the system determines a likelihood of the identified object being present at a location in the environment based on a comparison of the modified 3D model and the annotated floorplan.