Various systems and methods for controlling surgical devices are disclosed. A computer system, such as a surgical hub, can be configured to be communicably coupled to a surgical device and a camera configured to view an operating room. The computer system can be programmed to receive images of surgical staff members and surgical devices within the operating room during a surgical procedure. The computer system can further determine conditions or characteristics associated with the surgical staff members and surgical devices, such as whether a surgical staff member is performing a particular gesture or the pose of a surgical device, such as a surgical instrument, during a surgical procedure. The computer system can then control the paired surgical devices accordingly.