Example implementations described herein are directed to systems and methods for anomaly detection through using a segmentation process and an object detection process on images received through a camera system. The segmentation process and object detection process are then matched to detected additive anomalies (e.g., objects added to the environment) and subtractive anomalies (e.g., objects missing from the environment). Based on the type of anomaly detected as well as the underlying object, notifications can be dispatched to the user of the environment or the administrator of the system.