A modular audio system which includes an acoustic module configured to be removably engaged with a head-worn peripheral device. In some examples, the head-worn peripheral device is a pair of eyeglass frames and the acoustic module is configured to removably secure to a socket arranged on the inside face of the temples of the eyeglasses. The acoustic module may be configured to magnetically engage with the peripheral device such that, in a resting, coupled position, respective components of magnetic retention force are provided in at least two axial directions that are orthogonal to each other; i.e., a first component of magnetic retention force is provided in a first (horizontal) axial direction and a second component of magnetic retention force is provided in a second (vertical) axial direction.