An audio sharing system is configured to operate in at least two modes of operation. In a private mode, the audio sharing system outputs sound only to a user and may isolate the user from the surrounding acoustic environment. In a public mode of operation, the audio sharing system broadcasts sound to the user and to any other listeners in proximity to the user, thereby sharing sound in a social manner. The audio sharing system may also operate in other modes of operation that allow the selective sharing of sounds.