An image erasing apparatus comprises a reading unit configured to read a sheet having an image printed thereon with decolorable colorant and an owner information image printed thereon with decolorable colorant, and to identify a first owner information based on the owner information image. The apparatus further comprises a decoloring unit configured to decolor the sheet read by the reading unit and an authenticating unit configured to receive a second owner information. The apparatus further comprises a determining unit configured to determine a correlation between a user corresponding to the first owner information and a user corresponding to the second owner information, and an erasing controller configured to selectively control the decoloring unit to decolor the image and the owner information image based on the correlation.