An electronic device, an echo signal cancelling method thereof and a non-transitory computer readable recording medium is provided. The electronic device according to an exemplary embodiment includes a speaker configured to output a sound corresponding to a reference signal, a microphone configured to generate a microphone signal by obtaining a received sound, and a filter configured to cancel an echo signal of the reference signal from the microphone signal. In addition, the filter includes a first filter configured to estimate an echo signal of the reference signal and cancel the estimated echo signal from the microphone signal, and a second filter configured to generate an adaptive gain to cancel a residual echo from the microphone signal in which the estimated echo signal is canceled, and generate an output signal by using the generated adaptive gain and the microphone signal in which the estimated echo signal is canceled.