An object operation device for operating an object displayed on a display device, the object operation device includes a coordinate system generation unit that generates a local coordinate system for each of a plurality of points set around a reference object that is a reference of an operation when a target object is moved three-dimensionally by the operation, a move destination coordinates calculation unit that calculates move destination coordinates of the target object corresponding to a move command value of the target object inputted through an input device based on the local coordinate system of each of the generated plurality of points, and a moving process unit that moves the target object to the calculated move destination coordinates.