An autonomous vehicle may be partially controlled or monitored by a remote endpoint assigned to the autonomous vehicle. The autonomous vehicle sends one or more assisted driving messages directly to the autonomous vehicle or through a server. The server may identify multiple potential remote driving endpoints and assign one or more of the potential remote driving endpoints to the autonomous vehicle. The one or more potential remote driving endpoints return a command to the autonomous vehicle directly or through the server.