A method for processing speech data packets passed between a plurality of devices in a conversation is disclosed. The method associates priorities with each of the devices in the conversation and processes speech data packets received from the devices according to the priorities. Devices in the conversation are identified, a priority for each device is determined, and the priority for each device is associated with speech data packets transmitted from the device. The priorities may change during the conversation. If more than one speech data packet is received in a time window, the speech data packet with high priority is transmitted. Speech data packets that are not transmitted may be deleted or buffered. If a device is not assigned a priority, a low priority is assigned to speech data packets transmitted from the device.