The disclosed technology provides solutions for generating accurate virtual representations of real-world environments. A process of the disclosed technology can include steps for: processing image sensor data to identify one or more images of road paint; identifying a geographic location that is associated with the one or more images of road paint; and generating, within a simulated environment corresponding to the geographic location, at least one road paint mesh object that is based on the one or more images of road paint.