A vision system for a vehicle includes an image sensor and image processor. The image sensor is disposed at the vehicle and has a field of view exterior of the vehicle for capturing image data of a scene forward of the vehicle. The field of view encompasses at least a portion of a road surface ahead of and in the direction of travel of the vehicle. The image processor processes captured image data. Responsive to image processing of captured image data by the image processor, the vehicle vision system determines the presence of an animal on the road surface within the field of view. At least in part responsive to determination of the animal on the road surface within the field of view, the vehicle vision system at least one of (a) generates an alert and (b) controls the vehicle.