There is provided an operation control device including a motion detection part which detects an object to be detected, which is moved by motion of a user, a motion determination part which determines motion of the object to be detected based on a detection result, a movable region movement processing part which moves a cursor movable region including a cursor operating an object displayed in a display region, and a cursor movement processing part which moves the cursor. Based on motion of a first detected object, the movable region movement processing part moves the cursor movable region along with the cursor in the display region by a first movement unit. Based on motion of a second detected object, the cursor movement processing part moves only the cursor in the cursor movable region by a second movement unit smaller than the first movement unit.