A video decoder may be configured to output layers of video data according to layers specified in an output layer set mode as well as based on the actual layers received in an access unit. Accordingly, the video coder may be configured to output layers actually received rather than restart a video bitstream in situations where the layers actually received do not match the layers specified in the output layer set mode. In another example, a video encoder may disable inter prediction when the sub-picture ID of a sub-picture in a currently coded picture does not match the sub-picture ID of a sub-picture in a reference picture.