Systems and methods are disclosed that include a video-based analysis system that detects, tracks and archives vehicles in video stream data at multiple resolutions. The system includes an image capturing device that captures video stream data having video at a first high resolution. A vehicle detection module detects at least one vehicle within the video. A vehicle analysis module is configured to analyze the video and to extract one or more key vehicle features from the video to enable identification of a vehicle of interest (VOI) according to a set of predetermined criteria. A subsampling module creates a reduced resolution video stream in a second subsampled resolution that is lower than the first high resolution while maintaining the one or more extracted key features within the reduced resolution video stream in the first high resolution, and archives the reduced resolution video stream into a video database.