A vehicle control system includes a controller configured to determine whether a vehicle is operating in an autonomous driving mode or in a manual driving mode; and a steering device for adjusting a position of a wheel of the vehicle when the vehicle is operating in the manual driving mode. The steering device includes a knob configured to rotate about a rotation axis; a shaft connected to the knob, the shaft rotating about the rotation axis together with the knob by a rotational force transmitted from the knob; and an elastic part coupled to the shaft. In particular, when the shaft rotates from a reference position by the rotational force, the elastic part is compressed, and when the rotational force is removed, the elastic part is relaxed to return the shaft to the reference position.