Identification and management of audio output outlets connected to a user device is described. Once one or more audio output outlets connected to a user device are identified, an audio signal is forwarded to each detected audio output outlet and in an event the audio signal forwarded to an audio output outlet is detected by an internal audio sensor of the user device, that audio output outlet is designated as a loudspeaker. Audio output outlets designated as loudspeakers are muted when the user device is in silent mode. If the audio signal forwarded to an audio output outlet is not detected by the internal audio sensor of the user device, that audio outlet is marked as a private speaker. Audio output outlets designated as private speakers remain in an audible state even when the user device is in silent mode.