An image processing device for improving the accuracy of optical flow calculation when an optical flow is calculated in a window unit. An image processing device for calculating an optical flow on the basis of image information within a window for a processing target using a plurality of images captured at different times includes position acquisition means which acquires position information of the processing target and setting means which sets a size of a window for calculating an optical flow on the basis of the position information acquired by the position acquisition means.