Systems and methods to generate an environmental record for an interactive space are presented herein. An environmental record may represent a set of local environments and may define archival location compositions for the local environments. An archival location composition for a local environment may define aspects of the local environment associated with one or more objects and/or surfaces previously determined to be present in the local environment. A headset worn by a user in the local environment may generate a current location composition based on output signals from sensors included in the headset. The archival and current location compositions may be compared to determine updates for the environmental record.