An assembly is provided that includes a first component, a second component, a plurality of retainers and a fastener. The first component is configured with a plurality of first apertures. The second component is configured with a plurality of second apertures. Each of the retainers includes a pin and an arm projecting out from an end of the pin. The pin of each of the retainers is mated with a respective one of the first apertures and a respective one of the second apertures. The fastener is configured to fixedly connect the arm of each of the retainers to the first component.