Systems, methods, and media for on-line boosting of a classifier are provided, comprising: receiving a training sample; for each of a plurality of features, determining a feature value for the training sample and the feature, using the feature value to update a histogram, and determining a threshold for a classifier of the feature; for each of the plurality of features, classifying the training sample using the threshold for the classifier of the feature and calculating an error associated with the classifier; selecting a plurality of best classifiers from the classifiers; and, for each of the plurality of best classifiers, assigning a voting weight to the one of the plurality of best classifiers.