A sound signal processing system for achieving a handsfree function irrespective of positions of passengers using one microphone includes a microphone including a plurality of cores, and a head unit for generating a plurality of beams using a plurality of analog signals inputted from each of the plurality of cores, searching for a sound signal through each of the plurality of beams to select one beam, and outputting a sound signal corresponding to the selected beam.