An information processing apparatus includes an image taking means for taking images of a subject, a class-classification means for classifying a first image outputted by the image taking means into a class according to a characteristics thereof, a storage means for storing plural coefficient memories having different image taking conditions at the time of image taking, which store prediction coefficients according to the class acquired by learning, a designation means for designating one coefficient memory from among the plural coefficient memories based on the image taking condition when the image was taken by the image taking means, and a calculation means for calculating a second image in which noise is removed from the first image by calculating a prediction coefficient of the class of the first image, which is in the designated coefficient memory.