This invention provides a secure self-driving system or drive-assisting system. A drive control system of the present invention has an image recognition unit for detecting the peripheral environment of a vehicle and a drive control apparatus that controls driving of the vehicle, characterized by having a peripheral environment storage unit for storing the peripheral environment of the vehicle and by changing a mode of drive control performed by the drive control apparatus on the basis of a detection performance status of the image recognition unit obtained on the basis of information about the peripheral environment stored in the peripheral environment storage unit and information detected by the image recognition unit.