A combination of a hearing aid (1) and an adapter shoe (13), wherein the hearing aid has a pivotable battery compartment (6), and wherein the adapter shoe has engagement means (14, 15) for engaging the exterior of the hearing aid housing, blocking means (21) for blocking pivoting of the pivotable wall, and engagement means (23) for engaging the pivotable wall. The invention also provides an adapter shoe and a method of attaching an adapter shoe.