A system, method and program product training and verifying using an identity or entity model. A training system is disclosed that includes: a feature correlation system that groups features from an inputted feature data sample into subsets; a plurality of classifiers that determine if each feature classifies into an associated one of a plurality of feature models that make up the entity model; and a boosting system that boosts features from a subset for a next round of training if any of the features classify and at least one correlated feature from the subset does not classify. A verification system is disclosed that includes an identity model for the entity comprising a plurality of feature models, wherein each feature model is utilized to model a unique feature; a system for receiving a feature data sample and partitioning the feature data sample into a plurality of features; a system for determining if each of the plurality of features classifies into an associated feature model; and a voting system for analyzing a result of each attempted classification and determining an overall verification result.