A fastener system that includes a fastener, a compression-limiting sleeve, and a retainer which generally retains the compression-limiting sleeve on the fastener. By providing that the compression-limiting sleeve is not staked to the fastener, existing technology can be used, and no extra staking processing step needs to be performed. The fastener may comprise a conventional metal threaded screw or bolt, possibly having a recess in its head for receiving a driver. Preferably, the compression-limiting sleeve is cold headed as opposed to being stamped, and preferably includes a counter bore which assures that an end of the retainer is below an end surface of the compression-limiting sleeve. Preferably, the retainer is formed of a thermoplastic elastomer or another suitable material.