A vehicular image sensing system includes an imaging sensor having a forward field of view to the exterior of and through the windshield of an equipped vehicle. The imaging sensor is operable to capture image data and the image sensing system includes a control having an image processor. The image sensing system identifies objects of interest in the forward field of view of the image sensor via processing of the captured image data by the image processor. Identification of objects of interest may be enhanced by comparing objects over successive frames of captured image data. Objects of interest may be qualified and/or disqualified based at least in part on object motion in the field of view of the imaging sensor. The image processing may include pattern recognition.