In one example, a video endpoint obtains, from a vertical microphone array, a first audio signal including audio from a target sound source and audio from a horizontally-displaced sound source. The video endpoint obtains, from a horizontal microphone array, a second audio signal and a third audio signal both including the audio from the target sound source and the audio from the horizontally-displaced sound source. Based on the second audio signal and the third audio signal, the video endpoint determines at least one of a first degree of arrival of the audio from the target sound source or a second degree of arrival of the audio from the horizontally-displaced sound source. Based on the at least one of the first degree of arrival or the second degree of arrival, the video endpoint adjusts a gain of the first audio signal.