A displacement estimation device includes a vector calculator and a displacement calculator, for use in estimating a displacement vector from a pattern in a first original image to a pattern in a second original image. The vector calculator calculates a parameter for each pixel in the first original image and the second original image. The parameter of a pixel integrates the information of the intensities of all the pixels in a region of interest (ROI) surrounding the pixel, and the relative distances from all the pixels in the ROI to the pixel. The displacement calculator calculates the displacement vector from a pattern in the first original image to a pattern in the second original image based on the parameters calculated by the vector calculator for the first original image and the second original image.