A method of manufacturing a gear member formed into a cylindrical shape, the gear member having an internal gear disposed without overlapping the bearing holding portion in an axial direction, the method including: preparing a cylindrical material with a small-diameter cylindrical portion having an inner diameter corresponding to a tooth tip diameter of the internal gear in a tooth width region of the internal gear such that the small-diameter cylindrical portion is extended from the tooth width region toward the one end portion to reach the bearing holding portion; and inserting a skiving cutter from the other end portion side opposite to the one end portion of the cylindrical material to form the internal gear by skiving in the tooth width region of the small diameter cylindrical portion, and terminating the skiving at a halfway position before reaching the bearing holding portion and across the tooth width region.