A vehicle control system includes a light-receiving section which has a plurality of filters having different pass bands, and a plurality of light-receiving elements, each of which receives incident light via any one of the filters; an image data generation section which, when receiving general image data which is an output of the light-receiving section, extracts outputs of the light-receiving elements correlated to the filters to generate discrete image data, which is image data for each of the filters; an image data processing section which detects at least one object, based on the discrete image data generated by the image data generation section or composite image data generated by combining the discrete image data; and a vehicle control section which performs vehicle control, according to the object detected by the image data processing section.