An accessory system has one or more accessory elements which are removably attachable to a waist belt. A loop is fastened to the rear wall of each accessory element to define a passage between the rear wall and the loop which extends generally perpendicularly to the direction of the belt. A first part of a two-part fastener such as a snap is attached to an exterior surface of the loop. A strap is fastened to the accessory element rear wall spaced from the loop. A second part of the two-part fastener is configured to mate with the first part of the two-part fastener. The second part is fixed to the strap, so the strap is capable of passing through the loop, and around the loop to bring the first part and the second part of the fastener into engagement to retain the belt between the strap and the accessory rear wall.