A method of automatically producing maps and measures that visualize and quantify placement and progress of construction elements, such as walls, ducts, etc. in images. From a set of images depicting a scene, element confidences per pixel in each of the images are produced using a classification model that assigns such confidences. Thereafter, element confidences for each respective one of a set of 3D points represented in the scene are determined by aggregating the per-pixel element confidences from corresponding pixels of each of the images that is known to observe the respective 3D points. These element confidences are then updated based on primitive templates representing element geometry to produce a 3D progress model of the scene.