A method for forming a wheel bearing apparatus where the end portion of the cylindrical portion is pre-formed as a cylinder prior to its plastic deformation to form the caulking portion. A caulking tool with a punch and a swing shaft abuts against the end portion of the cylinder at a predetermined inclined angle relative to the inner circumferential surface of the cylinder. Teeth on the punch form the face-spline by plastically deforming the end face of the caulking portion. The swing shaft central axis is inclined at an angle relative to a central axis of the wheel hub. The face-spline is formed simultaneously with the formation of the caulking portion by advancing the caulking tool toward the wheel hub. A main shaft is rotated to cause a swing motion of the caulking tool.