Methods and systems for reducing the required footprint of SNoW-based classifiers via optimization of classifier features. A compression technique involves two training cycles. The first cycle proceeds normally and the classifier weights from this cycle are used to rank the Successive Mean Quantization Transform (SMQT) features using several criteria. The top N (out of 512 features) are then chosen and the training cycle is repeated using only the top N features. It has been found that OCR accuracy is maintained using only 60 out of 512 features leading to an 88% reduction in RAM utilization at runtime. This coupled with a packing of the weights from doubles to single byte integers added a further 8× reduction in RAM footprint or a reduction of 68× over the baseline SNoW method.