An external portion of an auditory prosthesis includes an external magnet that interacts with an implanted magnet to hold the external portion against the skin of a recipient. A magnetic component can be disposed proximate either or both of the external magnet or implanted magnet to channel the magnetic field associated therewith. The magnetic component can be moved relative to its associated magnet so as to adjust the magnetic field, and thus, the retention force between the magnets.