A computer implemented method comprising accessing a decision service, determining a subset of the decision logic, inserting a causal probe into the decision service, receiving a query at the interface of the decision service, executing the decision logic to determine the one or more outputs for the decision service for the received query, and outputting the one or more outputs and the causal history from the decision service for the received query. The causal history can be accessed at a later date and used to generate a causal model that can be used to determine an explanation for the original decision.