A speaker array apparatus includes a speaker array that emits sounds of a plurality of channels, a beam formation calculating section that performs a calculation for controlling phases of the sounds so that the speaker array emits sound beams in directions set for the respective channels, a sound source localization applying section that performs a calculation for controlling the phases of the sounds emitted from the speaker array so as to form a plurality of virtual point sound sources, and performs a calculation of auditory sensation characteristics at a listening position on a basis of a head-related transfer function, a selecting section that selects one of the beam formation calculating section and the sound source localization applying section, and a phase controlling section that controls the phases of the sounds emitted from the speaker array on a basis of a calculation result of the beam formation calculation section which is selected by the selecting section or applies the auditory sensation characteristics and controls the phase of a wavefront from the virtual point sound source on a basis of a calculation result of the beam formation calculating section which is selected by the selecting section.