In one embodiment, a network assurance service that monitors one or more networks receives data indicative of networking device configuration changes in the one or more networks. The service also receives one or more performance indicators for the one or more networks. The service trains a machine learning model based on the received data indicative of the networking device configuration changes and on the received one or more performance indicators for the one or more networks. The service predicts, using the machine learning model, a change in the one or more performance indicators that would result from a particular networking device configuration change. The service causes the particular networking device configuration change to be made in the network based on the predicted one or more performance indicators.