Frequency features to be used for binary classification of data using a linear classifier are selected by determining a set of hypotheses in a d-dimensional space using d-dimensional labeled training data. A mapping function is constructed for each hypothesis. The mapping functions are applied to the training data to generate frequency features, and a subset of the frequency are selecting iteratively. The linear function is then trained using the subset of frequency features and labels of the training data.