The movement detection apparatus acquires a movement state of an object by clipping a template pattern from first image data and seeking a region having a high correlation with the template pattern in second image data. The movement detection apparatus performs at least one of first processing, which analyzes the first image data, and second processing, which analyzes a relationship between the first image data and third image data acquired after the first image data has been acquired and before the second image data is acquired, and sets a position at which the template patter is clipped.