The present disclosure relates to systems and methods for constructing and indexing a database with joint profiles for persons viewed by multiple wearable apparatuses. In one implementation, a system for updating profile information based on data collected by a wearable apparatus may include a database storing a plurality of profiles and at least one processing device. The at least one processing device may be programmed to obtain identification information associated with a person detected in one or more images captured by a wearable image sensor included in the wearable apparatus; obtain, from the wearable apparatus, auxiliary information associated with the detected person; identify, in the database, a profile associated with the detected person based on the identification information; and update the identified profile based on the auxiliary information.