An apparatus for controlling driving of a vehicle is provided. The apparatus includes: a sensor to sense an environment outside of the vehicle, a positioning device to measure a current position of the vehicle, and a controller to calculate a first weighted time to collision with another vehicle using an accident severity index obtained based on the environment outside the vehicle and the current position of the vehicle and to control collision avoidance based on the calculated first weighted time to collision. The apparatus performs strong control to avoid a collision in an external environment incapable of being sensed by a sensor, thus reducing occurrence of an accident of the vehicle and damage due to the accident of the vehicle.