A driver assistance system for a vehicle includes an imaging device having a field of view forward of a vehicle and an image processor operable to process image data captured by the imaging device. The vehicle includes a control system operable at least in part to control the speed of the vehicle. The control system may reduce the speed of the vehicle responsive at least in part to a detection of a curve in the road ahead of the vehicle via processing by the image processor of image data captured by the imaging device. The control system may control the speed of the vehicle to a reduced speed for traveling around the detected curve in the road, and may increase the speed of the vehicle to above the reduced speed when the vehicle is traveling along a straighter section of road after the curve in the road.