User interface devices for manipulating a robotic surgical tool in a surgical robotic system are described. A user interface device can include a device housing having a gripping surface symmetrically disposed about a central axis. The gripping surface can include a surface of revolution about the central axis. A tracking sensor can be mounted within the device housing to generate spatial state signals in response to movement of the device housing. The spatial state signals can be used to control motion of robotic system actuators. A finger clutch can be disposed at an end of the device housing, and can generate a clutch signal in response to a touch by a user. The clutch signal can be used to pause the motion of the robotic system actuators. Other embodiments are also described and claimed.