An earth moving vehicle (EMV) autonomously performs an earth moving operation within a dig site. If the EMV determines that a state of the EMV or the dig site triggers a triggering condition associated with a pause in the autonomous behavior of the EMV, the EMV determines a risk associated with the state or triggering condition. If the risk is greater than a first threshold, the EMV continues the autonomous performance and notifies a remote operator that the triggering condition was triggered. If the risk is greater than the first threshold risk but less than a second threshold risk, the EMV is configured to operate in a default state before continuing and notifying the remote operator. If the risk is greater than the second threshold risk, the EMV notifies the remote operator of the state pauses the performance until feedback is received from the remote operator.