A method for enhancing knowledge discovery from a dataset uses visualization of a subset features within a dataset that provide the best separation of the dataset into classes. One or more classifiers are trained using each subset of features and the success rate of the classifiers in accurately classifying the dataset is calculated. The success rate is converted into a ranking that is represented as a visually distinguishable characteristic. One or more tree structures may be displayed with a node representing each feature, and the visually distinguishable characteristic is used to indicate the scores for each feature subset. Connectors between the nodes may be used to indicate unconstrained and constrained feature sets. Nodes within a constrained path may be substituted for a feature within the preferred, unconstrained path if that feature is impractical to measure.