Localization data is accessed, which is based on information collected by one or more sensor devices deployed within an environment. The localization data identifies presence of a person within a particular location within the environment. A feature vector is access, which includes values to describe a plurality of different physical characteristics of the person as measured by a set of one or more sensor devices deployed within the environment when the person was present within the particular location. An emotion of the person is determined from the feature vector data, and the emotion is associated with the particular location within the environment. An emotion heat map is generated of the environment to map emotional responses determined within the environment to specific locations within the environment.