A vehicular forward viewing image capture system includes an accessory module configured for attachment at an in-cabin side of a windshield of a vehicle, whereby a CMOS image sensor views through the windshield forward of the vehicle. With the accessory module attached at the in-cabin side of the windshield, and while the vehicle is traveling along a road, captured image data is processed to determine movement of an object of interest viewed by the image sensor. Multiple frames of captured image data are processed in determining movement of the object of interest. The accessory module includes an electrical connector for electrically connecting to a vehicle wiring system of the vehicle. Image data captured by the image sensor may be processed for an automatic headlamp control system of the equipped vehicle. The vehicular forward viewing image capture system may compensate for misalignment of the image sensor.