Method, apparatus and system are described to perform a feature eliminating method based on a support vector machine. In some embodiments, a value for each feature in a group of features provided by a training data is determined. At least one feature is eliminated from the group by utilizing the value for each feature in the group. The value for each feature in the group is updated based upon a part of the training data that corresponds to the eliminated feature.