Systems and methods for analyzing communication sessions using fragments are provided. In this regard, a representative method includes: delineating fragments of an audio component of a communication session, each of the fragments being attributable to a party of the communication session and representing a contiguous period of time during which that party was speaking; and automatically assessing quality of at least some of the fragments such that a quality assessment of the communication session is determined.