A method of controlling an output of an ultrasonic speaker that reproduces audible-frequency-band signal sounds by modulating carrier waves with audible-frequency-band signal waves output from a signal source and driving an ultrasonic transducer with the modulated waves includes: dividing the audible-frequency-band signal waves into a plurality of frequency bands; separately adjusting amplitudes of the signal waves and amplitudes of the modulated waves in the respective frequency bands; and driving a plurality of ultrasonic transducers provided corresponding to the respective frequency bands with the modulated waves generated corresponding to the respective frequency bands. Band-corresponding volume setting data, which is used to set volume of the ultrasonic transducers corresponding to the respective frequency bands by means of a plurality of band-corresponding volume setting units provided corresponding to the respective frequency bands, and overall volume setting data, which is used to set volume in common with respect to the plurality of ultrasonic transducers by means of an overall volume setting unit, are provided. Gains of modulated wave amplitude adjustment units that adjust the amplitudes of the modulated waves in the respective frequency bands are determined corresponding to the respective frequency bands on the basis of a combination of the band-corresponding volume setting data and the overall volume setting data.