An echo canceler 10 generates an echo elimination signal by filtering through adaptive filters 101 and 102 reference signals input from sound sources causing echoes. It includes a sound source number detecting unit 103 for detecting the number of the sound sources causing echoes from the reference signals, and a control unit 105 for making the number of taps of the adaptive filters 101 and 102 variable in accordance with the number of the sound sources detected by the sound source number detecting unit 103.