In some embodiments, a method determines a reward metric based on feedback for an instance of content. A delivery status for a delivery constraint of the instance of content is applied to the reward metric to generate a constrained reward metric. The method uses the constrained reward metric to train a model. The model is used to select from a plurality of instances of content. One of the plurality of instances of content is selected for delivery using the model.