A semiconductor defect classification device includes feature extractors that are configured to receive images of semiconductor patterns on a wafer and to extract features of the images from the images, and a classifier that is configured to receive the features of the images and first meta information about the wafer and to use machine learning to classify a defect of the semiconductor patterns associated with the images based on the features of the images and the first meta information.