A system and a method for remotely controlling a medical device based on image data are disclosed. The system includes a medical device, an image sensor, and a remote caregiver interface. The medical device includes a controller coupled to a communication network. The image sensor is coupled to the communication network and is configured to capture image data. The remote caregiver interface is coupled to the communication network and is configured to display the image data for viewing by a user, receive a selected remote control function from the user, and transmit an input signal corresponding to the selected remote control function to the controller of the medical device to execute the selected remote control function based on the input signal.