The image management device includes a related image selection module and an auxiliary labeling module. The related image selection module selects one or more related images having a certain relationship to a classification labeled image which is assigned a classification label indicating image classification. The auxiliary labeling module assigns an auxiliary label to the related images, the auxiliary label indicating the certain relationship.