A driver assistance system for a vehicle includes an imaging device having a field of view forward of a vehicle equipped with the driver assistance system and in a direction of travel of the equipped vehicle. The imaging device is operable to capture image data and an image processor is operable to process image data captured by the imaging device. The equipped vehicle includes an adaptive speed control system for controlling the speed of the equipped vehicle, and the speed of the equipped vehicle is controlled by the adaptive speed control system at least in part responsive to processing by the image processor of image data captured by the imaging device.