A method for analyzing jitter using a test and measurement instrument includes obtaining a collection of time interval error (TIE) values corresponding to composite jitter of a waveform, optionally decomposing the composite jitter into jitter components that are correlated to the data pattern and components that are uncorrelated to the data pattern, and using a spectral approach to decompose the jitter components into jitter components that are recognizable as deterministic and jitter components that are unrecognizable as deterministic. Thereafter, the jitter components analyzed in the frequency domain are converted back to the time domain, and subtracted from the composite jitter, thereby isolating uncorrelated residual jitter. The uncorrelated residual jitter is decomposed into bounded uncorrelated jitter and random jitter, for example, by integrating a probability density (PDF) function of the residual jitter and analyzing the resulting cumulative distribution function (CDF) curve in Q-space.