An audio signal processing apparatus includes a tapping detection unit to which an audio signal picked up by a microphone is input and that detects a tapping input operation on the basis of an energy increase/decrease determination process for making a determination as to whether an increase and a decrease of an energy level of low-frequency components of the audio signal occur within a first time period; and a control unit that performs a certain control process that is set for a tapping input operation in response to a tapping input operation being detected by the tapping detection unit.