Sensor information is received. Based at least in part on at least one state detected using the sensor information, an expected value for automatically performing an action associated with a device controlled by a device controller system is evaluated as compared to an expected value for potentially performing, subject to a user interactive qualification, the action associated with the device controlled by the device controller. It is determined that the expected value of automatically performing the action is insufficient to trigger automatically performing the action without being subject to the user interactive qualification. A confirmatory indication is identified. Based at least in part on the confirmatory indication, an instruction is sent to the device to perform the action.