A medium conveying apparatus includes a feed roller, a brake roller, a motor to generate a driving force, a first transmission mechanism to transmit the driving force to the brake roller through a first torque limiter, to rotate the brake roller in a direction opposite to a medium feeding direction, a second transmission mechanism to transmit the driving force to the brake roller through a second torque limiter, bypassing the first torque limiter, to rotate the brake roller in the direction opposite to the medium feeding direction, and a processor to detect media multi-feed, and perform control in such a way as to transmit the driving force to the brake roller by the second transmission mechanism and also cause the feed roller to be driven to rotate in the direction opposite to the medium feeding direction by the brake roller, when the media multi-feed is detected.