An apparatus for modifying an audio signal has an envelope shape determiner, a filterbank processor, a signal processor, a combiner and an envelope shaper. The envelope shape determiner determines envelope shape coefficients based on the a frequency domain audio signal representing a time domain input audio signal and the filterbank processor generates a plurality of bandpass signals in a subband domain based on the frequency domain audio signal. Further the signal processor modifies a subband domain bandpass signal of the plurality of subband domain bandpass signals based on a predefined modification target. The combiner combines at least a subset of the plurality of subband domain bandpass signals containing the modified subband domain bandpass signal to obtain a time domain audio signal. Further, the envelope shaper is operative to obtain a shaped audio signal.