An interconnecting module configured to be mounted in a High-Performance Computing (HPC) cabinet in order to interconnect a plurality of computing units located in the HPC cabinet. The interconnecting module comprising a chassis configured to be mounted horizontally within housings defined in the computing units, a plurality of connection units spaced vertically, each connection unit being configured to be connected to a motherboard of a computing unit, the connection units being interconnected, each connection unit comprising at least a fastening member configured to cooperate with a housing of a computing unit, a vertical rack cooperating with all the fastening members and at least a main lever mounted pivotally on the chassis, the main lever being configured to move the vertical rack vertically in order to engage/disengage all the fastening members simultaneously.