A vehicle control device includes an information acquisition unit acquiring information on the frontward image including the traveling road surface of the host vehicle; a recognition unit recognizing the traveling environment of the host vehicle based on the frontward image acquired by the information acquisition unit; and the autonomous driving control unit performing control of the autonomous driving including at least one of a speed control and a steering control of the host vehicle based on the traveling environment recognized by the recognition unit, wherein the recognition unit includes the extraction unit extracting a defective image in the frontward image; and the autonomous driving control unit limits functions related to the defective image among the plurality of functions involved in the autonomous driving when the defective image is extracted by the extraction unit.