A method of decoding video data includes determining, by a video decoder implemented in processing circuitry, a context initialization using a plurality of quantization parameters for a portion of a picture of video data decoded using temporal prediction. The method includes storing, by the video decoder, the context initialization with a single probability state for the plurality of quantization parameters. The method includes entropy decoding, by the video decoder, a set of syntax elements in a bitstream using the single probability state.