A local video conference system executing a video conference application, that lacks an ability or functionality to control a remote camera of a remote video conference system, can display video from the remote video conference system. The local video conference system can also execute a controller application that can provide the local video conference system control of the remote camera. The controller application can receive user input that selects a region of multiple regions of a display window of the video conference application indicating a camera action for the remote camera, can determine a camera action based on the user input and the selected region, and can provide the camera action to the remote video conference system via a network. The remote video conference system can pan, tilt, and/or zoom the remote camera based on the camera action received from the controller application of the local video conference system.