A method, system, and computer program product for analyzing image attachments to email messages and reliably determines whether the image includes spam, so that the message can be blocked. A method for processing email messages comprises processing an image included in or attached to an email message to determine whether the image includes features that indicate whether the image is spam and determining whether the image is spam based on the included features that indicate whether the image is spam.