A method of annealing a metal member includes: disposing a first heater in an inner space of a hollow cylindrical metal member having an inner peripheral surface provided with plural teeth protruding toward a central direction, the first heater radiating infrared light and being disposed so as to extend parallel to a direction of a central axis of the metal member; heating the metal member from the inner space with the first heater; and gradually cooling the metal member after heating.