Techniques are provided to estimate of location or position of objects that are depicted in an image of a scene. Some implementations include obtaining an image of a scene; identifying an object within the image of the scene; obtaining a three-dimensional model that corresponds to the object that was identified within the image of the scene, the three-dimensional model being obtained from the database of three-dimensional models; determining, based on data from the three-dimensional model, an estimated depth of the object within the scene; generating or updating a three-dimensional representation of the scene based at least on the estimated depth of the object within the scene; and providing the three-dimensional representation of the scene, including at least a portion of the three-dimensional representation of the scene that was generated or updated based on the three-dimensional model of the object, to the scene analyzer.