A controller for augmenting reality in a three-dimensional (3D) space includes a memory that stores instructions; and a processor that executes the instructions. The controller controls a display system configured to present virtual objects in the 3D space. When executed by the processor, the instructions cause the controller to perform a process. The process includes detecting a first action by a user relative to an object or a virtual object in the 3D space. The process also includes selectively enabling or disabling a virtual operation member based on detecting the first action between the user and the object or virtual object in the 3D space. The virtual operational member is configured, when operated, to control operation of a machine in the 3D space.