Systems, methods, and other embodiments associated with decision making with analytically combined split conditions are provided. In one embodiment, a method for classifying data is provided. An input data sample is received for classification as belonging to one of two possible classes. The input data sample includes a set of attribute values. The method includes evaluating the set of attribute values with a tree function that defines a decision boundary of a classification tree. The tree function classifies an input data sample as belonging to one of the two possible classes based, at least in part, on the attribute values of the input data sample. In another embodiment parameters of the tree function are derived by applying a gradient descent parameter update rule to the training data samples.