Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining retraining predictive models. One of the methods includes maintaining, by a computer system of an enterprise, one or more predictive models. The computer system receives operational data and uses each of the one or more predictive models to generate predictions using the received operational data. An indication of a systemic change in the computer system is received. The method includes determining that one or more retraining rules specify that at least one of the one or more predictive models should be retrained due to the systemic change, and in response, obtaining updated training data and retraining the predictive model using the updated training data.