A voice relaying apparatus includes a receiving section for receiving a cell from an asynchronous transfer mode (ATM) network, a plurality of cell assembling/disassembling units for assembling and disassembling the cells, and a transmitting section for transmitting the cells assembled by each of the plurality of cell assembling/disassembling units. Each of the plurality of cell assembling/disassembling units is composed of a cell disassembling section for disassembling the cell received by the receiving section, a detecting section for detecting whether or not the voice relaying apparatus is carrying out a relay switch operation, and a cell assembling section for assembling the cell disassembled by the cell disassembling section and then sending to the transmitting section, if the fact that the voice relaying apparatus is carrying out the relay switch operation is detected by the detecting section.