A computer-aided image interpretation method and a device thereof to easily obtain an accurate image interpretation result are provided. An automatic classification means of the image interpretation device performs automatic classification by one of spectral characteristics, radiometric characteristics, diffuse characteristics, textures and shapes, or combinations thereof and accumulates data to an interpretation result database, for plural features of the same kind obtained by interpreting a remote sensing image obtained with an observation sensor. A means for extracting candidate of modification of interpretation result extracts the candidate of modification of interpretation result by comparing likelihoods that are the automatic classification results. A reinterpretation is performed for the candidate of modification of interpretation, and an interpretation result database is updated by an interpretation result update means. As a result, modification of the interpretation work can be efficiently performed.