Systems and methods for enabling an audio conference are provided. In one aspect, a system includes a transmitting device which receives audio signals representing sounds captured by at least two microphones from participants situated at a first location. A time-of-arrival delay between at least two of the audio signals is calculated and a beam-formed monaural audio signal and corresponding spatial data are generated and transmitted to remote participants situated at a second location. A receiving device processes the beam-formed monaural audio signal based on the spatial data to render and output spatial audio via speakers to the remote participants at the second location. In various aspects, the spatial data may include an angular value or a participant identifier that are determined based on the time-of-arrival delay. The spatial data may also indicate a total number of conference participants that are detected at the first location.