A method for automatically classifying scanned hardcopy media based on its physical size. The hardcopy media is classified as a photograph if the determined physical size matches a common physical sizes for photographs to within a predetermined tolerance, and is classified as a document if the determined physical size matches one of the common physical sizes for documents to within a predetermined tolerance. Otherwise, a media classification is determined using contextual processing.