A method of decoding video data including receiving an encoded video bitstream that includes a plurality of pictures and storing the plurality of pictures in one or more sub-DPBs. The method further including receiving a respective set of sub-DPB parameters for each respective operation point of the encoded video bitstream. applying the respective set of sub-DPB parameters to all layers of an output layer set for each respective operation point, and performing a sub-DPB management process on the one or more sub-DPBs in accordance with the received respective single sets of sub-DPB parameters.