A method includes receiving, at an audio encoder, multiple streams of audio data. The method includes assigning a priority to each stream of the multiple streams and determining, based on the priority of each stream of the multiple streams, a permutation sequence for encoding of the multiple streams. The method also includes encoding at least a portion of each stream of the multiple streams according to the permutation sequence.