In some embodiments, a method receives a first set of probabilities mapping a behavior to a user for a set of behaviors in a video delivery system. A first part of a model is used to predict the first set of probabilities. The method receives a second set of probabilities mapping a user to a behavior for a set of users that are using an account on the video delivery system. A second part of the model is used to predict the second set of probabilities. A combined probability is calculated for the set of behaviors and the set of users based on the first set of probabilities and the second set of probabilities. The method updates a second parameter of the second part of the model while keeping a first parameter of the first part of the model fixed and outputs the second parameter of the second part of the model upon determining the training of the model is finished.