A hearing assistance device may be turned on or off in response to a change in magnetic field or detection of a gesture. A magnetic sensor may be used to identify a change in a magnetic field. An inertial measurement unit or other force sensor may be used to detect a gesture. In response to the magnetic field change or gesture, a hearing assistance device may be caused to change a device function or change a device power mode.