A rack having multiple rack management modules is disclosed. Each rack management module respectively comprises a Rack Management Controller (RMC), a switch and a memory, wherein the switch of each rack management module is interconnected, a firmware is saved on each memory respectively. When the RMC receives a firmware update image and an updating command uploaded externally, the RMC sends a switching instruction to the switch for enabling the switch to switch and connect to the memory of another rack management module. When the RMC executes a firmware updating procedure, the firmware in the memory of another rack management module is updated via switch connection. The present invention can effectively avoid the issue that the RMC is not able to boot normally after the firmware updating fails leading to that the rack is not able to re-update the firmware.