A wheel bearing device, in which a swaged portion of a wheel hub abuts against a shoulder portion of a joint outer ring, is provided to positively prevent a stick slip noise from being generated at the time of the vehicle being pulled away from a parked position. The wheel bearing device includes an outer ring having double rows of race surfaces formed on its inner circumference; a wheel hub having one of the double rows of race surfaces formed on its outer circumference; an inner ring press-fitted over a reduced diameter step portion of the wheel hub and having the other of the race surfaces formed on its outer circumference; and double rows of rollers interposed on the respective race surfaces between the outer ring and the wheel hub and between the outer ring and the inner ring. The wheel bearing device is configured such that an end portion of the reduced diameter step portion of the wheel hub is swaged to thereby integrate the wheel hub with the inner ring, and a joint outer ring of a constant velocity universal joint is fitted into an inner diameter of the wheel hub via torque transmission means, allowing the swaged portion of the wheel hub to abut the shoulder portion of the joint outer ring. The swaged portion of the wheel hub is left non-quenched, whereas the surface-hardened abutted portion of the shoulder portion of the joint outer ring has a surface roughness of Ra 5.0 or more.