Disclosed are techniques for temporal scalable video coding. By including a temporal_switching_point_flag and/or a temporal_nesting_flag into a normative part of the scalable bitstream, reference picture management in decoder can be simplified, and media-aware network elements and decoder can easily identify those pictures from which onward a higher temporal layer can be added.