A vehicle data collection system includes a vehicle-mounted sensor; a non-transitory computer readable medium configured to store instructions; and a processor connected to the non-transitory computer readable medium. The processor is configured to execute the instructions for generating an invariant feature map, using a first neural network; and comparing the invariant feature map to template data to determine a similarity between the invariant feature map and the template data, wherein the template data is received from a server. The processor is further configured to execute the instructions for determining whether the determined similarity is exceeds a predetermined threshold; and instructing a transmitter to send the sensor data to the server in response to a determination that the determined similarity exceeds the predetermined threshold.