A video coding mechanism is disclosed. The mechanism includes encoding a coded layer video sequence (CLVS) for a layer in a bitstream. A sequence parameter set (SPS) referred to by the CLVS is also encoded into the bitstream. The SPS is constrained to have a network abstraction layer (NAL) unit header layer identifier (nuh_layer_id) value equal to a nuh_layer_id value of the CLVS when the layer does not use inter-layer prediction. The bitstream is stored for communication toward a decoder.