User interface devices for manipulating a robotic surgical tool in a surgical robotic system are described. A user interface device can includes a device body containing a tracking sensor to generate a spatial state signal in response to movement of the device body. The spatial state signal can be used to control a spatial motion of a surgical robotic system actuator. Several grip linkages can be pivotally coupled to the device body. A grip linkage displacement sensor may monitor movement of the grip linkages relative to the device body, and generate a grip signal in response to the movement. The grip signal can be used to control a grip motion of a robotic surgical tool mounted on the surgical robotic system actuator. Other embodiments are also described and claimed.