A fastener holder includes a driving tool stem having a number of orifices, a driving tool shank engaged in the stem for engaging with a tool element and having a number of depressions formed in the shank, a number of bearing members engaged in the orifices of the stem for engaging with the depressions of the shank and for selectively anchoring the shank to the stem, and a barrel includes a relatively smaller segment for selectively engaging with the bearing members and for forcing the bearing members to engage into the depressions of the shank and to anchor and lock the driving shank to the stem and for allowing the driving shank and the tool element to be selectively rotated and driven by the stem.