A refrigerator appliance may include a cabinet, a door, a camera module, and a controller. The camera module may be mounted to the cabinet. The controller may be operably coupled to the camera module. The controller may be configured to initiate an operation routine. The operation routine may include initiating an image capture sequence at the camera module. The image capture sequence may include a two-dimensional image captured at the camera module. The operation routine may further include determining an appendage-occupied region within the two-dimensional image and analyzing the appendage-occupied region in response to determining the appendage-occupied region. The operation routine may still further include assigning a confidence score to a user profile stored in the controller based on analyzing the appendage-occupied region, comparing the assigned confidence score to a threshold score, and recording metadata regarding the two-dimensional image based on comparing the assigned confidence score.