There is provided an information processing device including a captured image information acquisition portion which acquires captured image information corresponding to a captured image, a displayed image information acquisition portion which acquires displayed image information corresponding to a first image displayed on a display screen, and an object recognition portion which detects the position and the posture of the first image in the captured image using the displayed image information and the captured image information.