The subject specification comprises techniques employing multi-stage multi-layer switches for packet switching using fully shared buffers with a scalable switch fabric. A switch component includes a set of input modules (IMs) of switches that receive packets and are associated with a set of central modules (CMs) of switches that are associated with a set of memories. The switch component includes a second set of CMs associated with the set of memories, the second set of CMs being associated with a set of output modules (OMs) that can provide packets as output. A switch management component controls switching of the packets between the IMs and first set of CMs to the memories during a first switching phase, and switching of the packets from the memories to the second set of CMs to the OMs for output during a second switching phase, based on a defined scheduling algorithm.