An apparatus for controlling driving of a vehicle includes: an input device that receives an input signal corresponding to an operation of a driver; and a controller that sets a weight to a careless state of the driver based on a separation distance between the driver and the input device operated by the driver, a spaced angle, and a scheme of operating the input device, and calculates a braking application time point based on the weight.