In one example, a first headset establishes a connection with a second headset that is associated with a target participant. The first headset obtains, via the connection, a first audio signal corresponding to speech of the target participant. Based on the first audio signal, one or more parameters associated with a position or a movement of a head of a user of the first headset, one or more head-related transfer functions associated with a shape of the head of the user, and a layout of the environment of the first headset, the first headset modifies the first audio signal to produce a first modified audio signal that corresponds to the speech of the target participant that would be present at the head of the user in absence of the first headset and the noise generated in the environment.