Examples described may enable provision of remote assistance for an autonomous vehicle. An example method includes a computing system operating by default in a first mode and periodically transitioning from operation in the first mode to operation in a second mode. In the first mode, the system may receive environment data provided by the vehicle and representing object(s) having a detection confidence below a threshold, where the detection confidence is indicative of a likelihood of correct identification of the object(s), and responsive to the object(s) having a confidence below the threshold, provide remote assistance data comprising an instruction to control the vehicle and/or a correct identification of the object(s). In the second mode, the system may trigger user interface display of remote assistor alertness data based on pre-stored data related to an environment in which the pre-stored data was acquired, and receive a response relating to the alertness data.