A combustor cap module is provided with a retention system to facilitate assembly and disassembly. The combustor cap module further includes a cap face assembly having a cooling plate; a cylindrical sleeve including a connecting surface for attaching the cap face assembly to the retention assembly; and a coupling member mounted in a downstream fuel nozzle opening in the cooling plate. The retention system includes a support plate having an inner panel that defines an upstream fuel nozzle opening. The coupling member extends through the upstream fuel nozzle opening, such that its upstream end extends upstream of the support plate. A retaining ring at least partially encircles the upstream end of the coupling member and is engaged by a spring plate that is removably secured to the support plate at multiple locations. A method for assembling a combustor cap module is also provided.