A system and method for tracking and annotating products in a store shelf is disclosed. The method includes receiving a signal feed from a group of sensors including at least one depth sensor, determining an area of interest in the shelf, determining a polygonal representation of at least one product present in the area of interest, and assigning a unique polygonal profile to at least one product, and/or storing the unique profile in a database. Such The unique polygonal profile may include a unique ID obtained from a group of attributes. The unique profile may include at least a unique position and a unique centroid. The group of sensors may further include video cameras, thermal, and chemical sensors.