Systems and methods are provided for detecting foreign objects in or on a subject of interest. A first set of images is captured of a sample subject known to be free of foreign objects. A plurality of colors from a defined color palette are classified according to a color content of the first set of images into at least first and second classes. A second set of images of the subject of interest are captured. It is determined that a foreign object is present in or on the subject of interest if a color from the first class is present in the second set of images.