A jitter buffer system having a jitter buffer configured to buffer traffic and a control system coupled to the jitter buffer and configured to determine a first characteristic of the traffic in the jitter buffer, adjust the size of the jitter buffer by a constant when the first characteristic does not satisfy a first constraint for the first characteristic, determine a rate of adjusting the jitter buffer, and change the constant when the rate does not fall within a specified range.