Techniques and systems are provided for encoding and decoding video data. For example, a method of decoding video data includes obtaining an encoded video bitstream comprising one or more layer sets and one or more additional layer sets. The encoded video bitstream includes a video parameter set defining parameters of the encoded video bitstream. The one or more layer sets are defined in a base part of the video parameter set, and the one or more additional layer sets are defined in an extension part of the video parameter set. The method further includes decoding one or more syntax elements from the video parameter set. The one or more syntax elements include rate information for the one or more layer sets defined in the base part of the video parameter set and for the one or more additional layer sets defined in the extension part of the video parameter set.