A remote control device includes a light source for irradiating an instruction beam in a non-visible wave length range, and an operation unit for controlling the light source to irradiate the instruction beam when the operation unit is operated. An instruction beam detection apparatus includes an image capturing unit for capturing an image of the instruction beam irradiated from the light source of the remote control device within a detection range thereof; a storage unit for storing a first image captured with the image capturing unit; and a detection unit for detecting a position of the instruction beam on a second image according to a differential image between the first image stored in the storage unit and the second image newly captured with the image capturing unit.