To provide an input apparatus, a control apparatus, a control system, and a control method that are capable of restricting a movement of a pointer on a screen by a user operation even while the input apparatus is moving. In a state where a movement button is not pressed by a user, an MPU of an input apparatus is not outputting a movement command or is outputting a movement command with a displacement amount set to 0. In other words, even when the user holds the input apparatus and moves it, a pointer does not move on a screen. As a result, a movement of the pointer unintended by the user can be restricted. When the movement button is pressed, that is, when a first operation signal is input via a first switch, the MPU starts outputting the movement command. By receiving the movement command, an MPU of a control apparatus controls display of the pointer so as to start the movement of the pointer that corresponds to the movement command.