An image processing device includes: a rescaling unit configured to obtain an image subjected to scaling, and subject the image to rescaling with the scaling rate of the image; a block border information detecting unit configured to detect a block size and block border position from the image after rescaling; and a detected information correcting unit configured to correct the block size and the block border position detected by the block border information detecting unit based on the scaling rate.