A sound source signal processing apparatus including a first sound source detection unit having at least one microphone to detect a sound source signal, a second sound source detection unit having at least one microphone to detect the sound source signal, the second sound source detection unit being spaced apart from the first sound source detection unit, and a beamforming unit to beamform the sound source signal detected by the first sound source detection unit and the second sound source detection unit. At least one microphone is further provided in addition to the microphone array, and position information of the microphones and sound source information are used, thereby improving beamforming performance of the sound source signal. Also, the number and size of microphone arrays is reduced through further provision of the at least one microphone, thereby improving spatial utilization.