Determining control operations for an autonomous vehicle may include receiving, by an operational model, an operational model input based on camera data from one or more cameras of an automated vehicle; determining, by the operational model, based on the input, a current environmental state and a predicted environmental state; providing, to a rules module, a differential between the current environmental state and a previously predicted environmental state; and determining, based on the rules module, one or more control operations for the automated vehicle.