Techniques are described for compressing image data for transmission to a computer system of a remote operator controlling a vehicle. A visual representation of a surrounding environment is generated from one or more images captured at the vehicle. One or more regions of interest in the visual representation are identified based at least on information received from the computer system of the remote operator, the information indicating a direction or area of focus of the remote operator. Regions of interest can be compressed to a lesser extent than regions located outside the regions of interest. The compressed visual representation is transmitted to the computer system for decompression and, ultimately, display on one or more display devices viewed by the remote operator.