A face recognition system of a residential environment identifies an individual present in the residential environment. The residential environment include a plurality of home devices and is associated with a group of different persons. The face recognition system identifies which person in the group is the individual and generate an operating instruction for a home device based on identity of the individual. For example, the face recognition system captures an image set of the individual's head and face and applies the image set to a machine learning model that is trained to distinguish between the different persons based on images of their heads and faces. The face recognition system can retrieve a personal profile of the identified individual, which includes settings of the home device for the identified individual. The face recognition system generates the operating instruction based on the personal profile.