A framework is disclosed for associating visual elements of a computer game with musical scores of a computer game. In one embodiment, a visual element is moved in a virtual environment of the computer game, in response to user input. Playback of a musical score may be altered based on movement of the visual element. A visual effect in the scene may also be generated, based on the altered playback of the musical score.