An autonomous driving device is provided. The autonomous driving device includes a driver comprising circuitry configured to drive the autonomous driving device, a sensor, a storage configured to store characteristic information for each type of obstacle, and a processor configured to control the driver based on a result of sensing of the sensor. The processor is configured to, based on an external object sensed by the sensor being recognized as an obstacle with a possibility of collision with the autonomous driving device, identify a type of the obstacle based on the characteristic information, and to control the driver to change at least one of a velocity and direction of the autonomous driving device based on the identified type of obstacle.