A method of encoding a video sequence comprising Reference Picture Sets (RPSs) is provided. The method comprises arranging the RPSs in transmission order in a data structure, such as a Sequence Parameter Set (SPS), determining whether explicit RPS transmission is used for an RPS of a current picture of the video sequence, and encoding information indicating an RPS comprised in the data structure to be used for predicting the RPS of the current picture, such as delta_idx_minus1, only if explicit RPS transmission is used. By transmitting delta_idx_minus1 only if explicit RPS transmission is used, and interpreting delta_idx_minus1 to be equal to zero otherwise, a reduced bitrate is achieved. Further, a method of decoding a video sequence comprising RPSs, corresponding computer programs and computer program products, as well as corresponding encoders and decoders are provided.