A method, computer-readable medium, and system are disclosed for an interactive storytelling environment. The method comprises identifying a plurality of storytelling devices available to participate in a storytelling experience, including a first storytelling device at a first physical location and a second storytelling device at a remote second physical location. The method further comprises receiving, based on user input during playback of a story, an instruction to perform a first action of a predetermined plurality of actions using the second storytelling device, the user input indicating a user interaction with a depiction of the second storytelling device at the first physical location. The method further comprises performing, based on timing information included in the received instruction, the first action using the second storytelling device such that performing the first action is at least partly synchronized with performance of an animation sequence of the depicted second storytelling device.