The present disclosure discloses an audio playback apparatus having noise-canceling mechanism that includes a sound receiving circuit, a storage circuit, a filter control circuit, a filter circuit and an audio playback circuit. The sound receiving circuit receives received audio signal including noise. The storage circuit stores filter parameters. The filter control circuit includes a noise estimation circuit, a noise distribution determination circuit and a parameter generation circuit. The noise estimation circuit receives the received audio signal and calculates a stationary noise power spectrum density of the noise such that the noise distribution determination circuit determines a noise spectrum distribution accordingly. The parameter generation circuit analyses the noise spectrum distribution and retrieves a group of selected filter parameters accordingly. The filter circuit filters the received sound signal according to the group of selected filter parameters to generate an anti-noise audio signal. The audio playback circuit playbacks an actual audio signal and the anti-noise audio signal simultaneously.