A system for automatically capturing an event of interest in a venue is disclosed, comprising a plurality of cameras for capturing video images of the event; and at least one processor communicatively connected to said plurality of cameras and con figured to execute a plurality of modules, said modules comprising a rectification module for combining the video images to form a wide-angle view; at least one of a motion analysis module configured for tracking salient blobs that are not part of a background of the wide-angle view, an activity analysis module configured for extracting temporal and spatial patterns from the wide-angle view, and a shape and appearance module configured for selecting one or more objects in the wide-angle view based on descriptors that are scale and rotational invariant; and a region of interest selector for selecting a viewpoint from the wide-angle view based on output from at least one of the motion analysis module, the activity analysis module, and the shape and appearance module, wherein the region of interest selector outputs the selected viewpoint for display. The system further comprises at least one audio recording device for capturing audio from the event; and means for synchronizing the video images and audio.