Input data consisting of sensory inputs received about a user, and a work of expression by a computing device. Detecting a work, and or capturing its content using input devices. Tracking user input as any one of movements, physiological signals or eye direction, or actions within their environment. Producing conceptual profiles as semantic values consisting of a characteristics and meaning of a works content. Aggregating at least one conceptual profile or user inputs and transforming them into new or modified content for a virtual environment. This modified content may reflect the work, and user actions may be synchronized with the work. Tracking user interactions with an environment modified through input data, may recursively produce content changes to the work, for example changing the words in a book or updating the story, as displayed on a connected electronic book or mobile device used for reading.