A driving device includes: a first motor that transmits power to a rotation shaft of a conveyance roller for conveying a paper sheet; a second motor that transmits power to the rotation shaft of the conveyance roller; and a motor controller that controls rotational speeds of the first and second motors by changing a control value, wherein the motor controller controls the control value of the first motor at multiple steps at a time of acceleration or deceleration and changes the control value of the second motor according to a change range of the control value of the first motor in synchronization with a timing when the control value of the first motor is changed.