A method and an apparatus for enabling adaptive audio signal alteration are described. When an input audio signal is received, a determination of whether the user of an audio device hears the input audio signal is performed based upon brain activity of the user. A determination of whether the user is distracted by the audio signal is performed based upon sensor measurements indicating a physical state of the user. In response to determining that the user hears the input audio signal and that the input audio signal causes the user to be distracted, a determination of configuration parameter(s) is performed. An alteration of audio signal(s) is caused based upon the configuration parameter(s) to obtain modified version(s) of the audio signal(s) that are intended to address the distraction caused by the input audio signal, and output audio signals are output, where the output audio signals include the modified versions.