A device for controlling traveling of a vehicle is provided. The device includes a sensor that obtains vehicle traveling information, a navigation that obtains vehicle position information, and a controller that determines whether the vehicle has entered a building based on the vehicle traveling information and the vehicle position information. The controller calculates a traveling control amount based on the determination result. Accordingly, the device actively adjusts a vehicle height even when the vehicle enters the building and travels on a slope in the building preventing damage to a lower portion of the vehicle.