A system and method to automatically generate a secondary video stream based on an incoming primary video stream. The method including performing video analytics on the primary video stream to generate one or more analysis results, detecting the first target of interest using the analysis results, automatically extracting a first secondary video stream that captures at least a portion of a first target of interest and has a field of view smaller than that of the primary video stream, tracking the first target of interest, displaying the first secondary video stream, detecting a second target of interest using the analysis results, automatically adapting the first secondary video stream from the primary video stream to capture a portion of the first and second targets of interest, tracking the second target of interest, and displaying the first secondary stream including the portion of the first and second targets of interest.