A drowsy driving management device includes: a processor configured to determine whether slow eye movement of a user occurs and whether there is no change in steering torque and to determine that the user drives while drowsy when the slow eye movement of the user occurs and when there is no change in the steering torque for a predetermined period of time; and a storage that stores information indicating whether the slow eye movement occurs and a result of determining whether there is no change in the steering torque.