A technique for optimizing a prediction method of samples in blocks of an image is provided. The image includes a first block, a second block, a third block, and a fourth block, each of the blocks include 8×8 blocks and form one Macro block. The method includes performing a prediction of the second block, the third block and the fourth block by performing at least one of prediction methods. A prediction error per block (Pe) is computed for each prediction method that is performed to predict the second block, the third block, and the fourth block. The prediction error per block (Pe) equals an original block value minus a predicted block value. An optimal prediction method is chosen from each of the prediction methods performed that results in minimum Σ|Pe| pixels per block (summation on pixels per block). The optimal prediction method and the Pe for each block are stored.