A correlation processing apparatus that obtains a correlation value between an image and a subimage, the apparatus including: N arithmetic circuits, each of the N arithmetic circuits performing an arithmetic operation on a first image pixel value of a first image pixel of the image and a second image pixel value of a second image pixel of the subimage; a rectangular pattern selection circuit selecting a rectangular pattern among a plurality of predetermined rectangular patterns, the rectangular pattern including Q elements, the smallest number of divisions is obtained if the image is divided by the rectangular pattern; a control circuit activating Q arithmetic circuits among the N arithmetic circuits and identifying Q first image pixel values and Q second image pixel values on which the arithmetic operations are performed by the Q arithmetic circuits; and an accumulator accumulating the results of the arithmetic operations performed by the Q arithmetic circuits.