A system for sorting objects is provided. For instance, the system includes a first and second sensor for observing the objects before and after sorting and a controller having an action agent module and a learning agent module. The controller updates, by the learning agent module, a policy matrix after sorting previously sorted objects. The policy matrix includes state data of the previously sorted objects including sensor data, an action performed by the sorting actuator, and a sorting score. The controller actuates the sorting actuator, calculates a specific sorting score based on a specific action performed by the sorting actuator, and updates the policy matrix to create an updated policy matrix including updated sorting rules. The updated policy matrix is used in sorting subsequent objects. In another example, the controller loads a policy matrix that was determined incrementally during sorting of previously sorted objects.