A system is provided for identifying and quantizing a change in a scene having objects based on comparison of features representing a target object derived from a first image and a second image that includes the target object. The system segments, based on a scene model of the scene, a second image that includes the target object to identify a second area representing the target object within the second image. The system extracts, from the second image, second features for the target object based on the second area. The system determines a second effectiveness of the second features indicating effectiveness of the second features in representing the target object. The system detects a change based on a difference between first features and the second features factoring in a first effectiveness and the second effectiveness.