In a scheme in which only a part of one picture is intra-predicted and the rest of the region is inter-predicted, generation of a significant code amount and generation of a delay can be avoided in a specific picture. However, because only a part of the picture is coded by means of the intra prediction, coding efficiency is deteriorated as compared to an I picture in which the entire picture is coded by means of the intra prediction. A picture is split into a restricted region and a non-restricted region. Prediction is performed by using an intra prediction in which only a pixel of the restricted region is referred to or an inter prediction in which a restricted reference region of a reference picture is referred to for a block of the restricted region. Prediction is performed by using the intra prediction in which a decoded pixel in the picture is referred to or the inter prediction in which the reference picture is referred to for the block of the non-restricted region. After decoding of the picture, the restricted region is configured as the restricted reference region.