A plurality of on-road vehicles moving along streets of a city, while utilizing onboard cameras for autonomous driving functions, are bound to capture, over time, random images of various city objects such as pedestrians, vehicles, building and other structures. Images of a certain city object may be captured by many of the vehicles at various times while passing by that object, thereby resulting in a corpus of imagery data containing various random images and other representations of that certain object. Per each of at least some of the city objects appearing more than once in the corpus of imagery data, appearances are detected and linked, and then analyzed to reveal behavioral/descriptive models associated with that city object and with interactions of the object with other objects. The models are then used to detect a recent emerging pattern that is then used to determine an appropriate service action.