An apparatus for generating one or more audio output channel signals depending on two or more audio input channel signals is provided. Each of the two or more audio input channel signals comprises direct signal portions and ambient signal portions. The apparatus comprises a filter determination unit for determining a filter by estimating first power spectral density information and by estimating second power spectral density information. Moreover, the apparatus comprises a signal processor for generating the one or more audio output channel signals by applying the filter on the two or more audio input channel signals. The first power spectral density information indicates power spectral density information on the two or more audio input channel signals, and the second power spectral density information indicates power spectral density information on the ambient signal portions of the two or more audio input channel signals.