In an information processing system 1, an information processing apparatus 10 recognizes, when a user moves real bodies 120a and 120b arranged on a play field 19, the movement on the basis of, for example, an image taken by a camera 122 taking an image of the movement to interlock objects of corresponding characters 202a and 202b displayed on a display apparatus 16. In addition, when the user moves the characters 202a and 202b through an input apparatus 14, the information processing apparatus 10 transmits a control signal to the corresponding real bodies 120a and 120b to perform interlocking. When a situation in which interlocking between the real bodies 120a and 120b and the characters 202a and 202b is difficult occurs, an appropriate scenario is selected from the scenarios prepared in advance and realized, thereby maintaining the consistency.