An image processing device includes an image acquiring unit, a color aid information acquiring unit, and a restoring unit. The image acquiring unit acquires, as a processing target image, an image with modified color information or an image with color information degraded from an original image. The color aid information acquiring unit acquires color aid information to be referred to at the time of restoring the color information of the processing target image. The restoring unit restores the color information of the processing target image on the basis of the color aid information.