In the case where an input image is an image of a non-YUV420 format and an encoding unit is the smallest CU block, an adaptive-sub-sampling luma reference pixel acquisition unit sub-samples reference pixels existing neighboring a luma block corresponding to a chroma prediction target block based on a luma intra prediction mode, and acquires a pixel value of each of the sub-sampled reference pixels. In the case where the input image is an image of a non-YUV420 format and the encoding unit is the smallest CU block, an adaptive-sub-sampling chroma reference pixel acquisition unit sub-samples reference pixels existing neighboring the chroma prediction target block based on the luma intra prediction mode, and acquires a pixel value of each of the sub-sampled reference pixels.