In general, the techniques of this disclosure may be used to control utilization of bandwidth allocated to an audio processing module. For example, to process various audio synthesis parameters, the audio processing module may retrieve reference waveform samples for use in generating audio information for voices within an audio frame, such as a MIDI frame. In some cases, the amount of bandwidth available for retrieving the reference waveforms from memory is limited. To manage the utilization of the allocated bandwidth a bandwidth control module estimates an amount of bandwidth required to retrieve reference waveforms for all the voices of the audio frame, and selects one or more voices to be eliminated from generated audio information when the bandwidth estimate exceeds the allocated bandwidth.