An image processing apparatus capable of reducing the amount of memory required for intra-frame prediction is provided. The apparatus includes a processing unit that performs sampling on pixels adjacent to a current block for intra-frame prediction according to a block size of the current block. The processing unit further performs interpolation by using the pixels being sampled to reconstruct the adjacent pixels. The processing unit further performs the intra-frame prediction by using the adjacent pixels being reconstructed to generate a predicted image.