In a personal listening device, an ANC system can benefit from a mechanism to detect an off-ear condition, which may be a situation in which the user of the personal listening device has moved an earphone or handset housing away from her ear. A detector may detect such a condition using signals from a touch sensor and/or a vibration sensor that are integrated in the earphone or handset housing, and in response power down the ANC system, or in the case of an adaptive ANC system slow down, or even freeze, the adaptation of one or more adaptive filters. The detector may operate during for example a phone call or during media file playback. Other embodiments are also described.