The disclosed technology generally relates to a hearing device configured adjust the tap detection sensitivity on based on context. The disclosed technology can determine a context for a hearing device based on sound received at the hearing device (e.g., determine loud environment) or a wireless communication signal from an external device received at the hearing device (e.g., receive a message that phone call is incoming); adjust a tapping sensitivity threshold of the hearing device based on the context; detect a tap of the hearing device based on the adjusted sensitivity threshold; and modify a setting of the hearing device (e.g., reduce volume based on a tap) or transmitting instructions to the external device based on detecting the tap. The hearing device can be a hearing aid.