This hollow shaft member 10 includes paired diameter-reduced sections 11 respectively formed at both shaft ends of a hollow shaft-like tubular material by performing swaging processing on both the shaft ends, and an intermediate section 12 located between the paired diameter-reduced sections, and having an outer diameter larger than an outer diameter of the paired diameter-reduced sections. Shapes of connection boundaries between the intermediate section 12 and the diameter-reduced sections 11 are formed as perpendicular step-shaped sections 13 stepped substantially perpendicular to an axial direction, and the perpendicular step-shaped sections 13 are formed by the swaging processing.