An object detection system for a host vehicle includes an imaging device, a ranging device and a processor. The imaging device has a field of view exterior of the host vehicle and is operable to capture image data representative of an object exterior the host vehicle. The ranging device has a field of view that sweeps at least the field of view of the imaging device and that detects the object exterior the host vehicle. The processor processes image data from the imaging device and processes data from the ranging device in order to determine if the detected object is an object of interest. The determination that the detected object is an object of interest is made in accordance with a priority score.