An intra prediction unit that performs intra-frame prediction includes a luminance reference pixel acquisition unit and a chrominance reference pixel acquisition unit. When the coding unit is set to a smallest CU block, the luminance reference pixel acquisition unit subsamples reference pixels arranged at integer pixel locates neighboring a luminance block that corresponds to a chrominance prediction target block, and acquires the pixel values of the reference pixels after the subsampling. Furthermore, when the coding unit is set to a smallest CU block, the chrominance reference pixel acquisition unit subsamples reference pixels arranged at integer pixel locates neighboring the chrominance prediction target block, and acquires the pixel values of the reference pixels after the subsampling. Such an arrangement is capable of reducing the number of reference pixels used to reduce the redundancy between the color components.