Embodiments disclosed herein provide systems, methods, and computer readable media for detecting disturbances in a media stream from a participant on a communication. In a particular embodiment, a method provides identifying disturbance criteria defining a plurality of audible disturbances, a plurality of visual disturbances, and a plurality of communication disturbances. The method further provides identifying one or more audible disturbances from an audio component of the media stream based on predefined disturbance criteria and identifying one or more visual disturbances from a video component of the media stream based on the disturbance criteria. Additionally, the method provides correlating the audible disturbances with the visual disturbances to determine one or more combined disturbances for the participant based on the disturbance criteria, wherein each of the combined disturbances comprises at least one of the audible disturbances and at least one of the visual disturbances.