One or more embodiments set forth an audio processing system for a personal listening device that includes a set of microphones, a noise reduction module, an audio ducker, and a mixer. The set of microphones is configured to receive a first set of audio signals from an environment. The noise reduction module is configured to detect when a signal of interest is present in the first plurality of audio signals, and, upon detecting a signal of interest, transmit a ducking control signal. The audio ducker is configured to receive the ducking control signal, and receive a second plurality of audio signals via a playback device. The audio ducker is further configured to reduce an amplitude of a second plurality of audio signals relative to the signal of interest based on the ducking control signal. The mixer combines the first plurality of audio signals and second plurality of audio signals.