A quick release connector for a power tool accessory having a center aperture. The connector comprises a body having a first end adapted to be attached to a shaft of a power tool and a second end that includes a connector head that is adapted to be moved axially into and to fit within the center aperture of the accessory for transferring motion from the power tool to the accessory. In one embodiment, the connector includes an indicator for providing a positive indication to a user that the connector head is properly secured to the accessory and, in another embodiment, the connector includes an ejector for pushing the accessory off of said connector head.