An electronic book is provided with a soundtrack, to which a reader can listen while reading the electronic book. The soundtrack accompanies and enhances the reading experience, in which readers generally have images in their minds based on the story or other visual media that is part of the electronic book. Playback of the soundtrack is synchronized with the visual display of the electronic book. Audio cues are associated with different points in the text and these cues are dynamically played back in synchronization with the visual display of the electronic book based on the interaction of the user with the electronic book. The dynamic playback involves editing and playing an audio cue so that it has a duration that is based on a prediction of the duration of the portion of the electronic book with which the cue is synchronized. When the system starts playing an audio cue, it predicts when the next audio cue should start. The current cue is played for predicted duration and a transition to the next audio cue is initiated at an appropriate time.