An image processing device includes: an abnormality candidate region detection unit configured to detect, from an intraluminal image obtained by imaging a living body lumen, an abnormality candidate region in which a tissue characteristic of the living body or an in-vivo state satisfies a predetermined condition; a feature data calculation unit configured to calculate, from each of a plurality of regions inside the intraluminal image, a plurality of pieces of feature data including different kinds; an integrated feature data calculation unit configured to calculate integrated feature data by integrating the plurality of pieces of feature data based on information of the abnormality candidate region; and a detection unit configured to detect an abnormality from the intraluminal image by using the integrated feature data.