An example method of video processing includes performing a conversion between a video including a video picture including one or more video units and a bitstream representation of the video. The bitstream representation conforms to a format rule that specifies that a first syntax element is included in a header of the video picture indicating allowed prediction types of at least some of the one or more video units in the video picture.