A howling control structure for a full duplex communication system. The structure is implemented as part of an acoustic echo canceller having a conventional transversal adaptive filter. A second transversal adaptive filter, shorter than the conventional filter, that adapts even in the absence of speech in its reference signal, is provided. The short filter adapts quickly and provides enough echo cancellation to prevent howling from occurring, even if the echo path is changed significantly during silence periods.