The solution presented herein defines from which previously decoded picture to retrieve the values for calculating POC of the current picture regardless of how many temporal layers have been decoded. That is achieved by determining the POC of the current picture, to be used by the decoder, as a sum of a syntax element pic_order_cnt_lsb and most significant bits of the POC, PicOrderCntMsb, of the current picture, wherein the PicOrderCntMsb of the current picture is derived using at least a prevPicOrderCntMsb and a prevPicOrderCntLsb and the prevPicOrderCntMsb is set equal to the most significant bits of the POC of a previous reference picture in decoding order that has a layer identity equal to zero and prevPicOrderCntLsb is set equal to the value of the least significant bits of the POC of a previous reference picture in decoding order that has a layer identity equal to zero.