An audio signal processing apparatus for rendering an input audio signal is disclosed. The audio signal processing apparatus includes a receiving unit, which obtains a plurality of input audio signals corresponding to sounds collected by each of a plurality of sound collecting devices, a processor, which obtains an incidence direction for each frequency component for at least some frequency components of each of the plurality of input audio signals corresponding to a sound incident to each of the plurality of sound collecting devices based on cross-correlations between the plurality of input audio signals, and generates an output audio signal by rendering at least some of the plurality of input audio signals based on the incidence direction for each frequency component, and an output unit, which outputs the generated output audio signal.