The present disclosure is directed to methods and systems for monitoring and replaying user interactions with one or more interactive electronic documents. The methods generally include identifying an event comprising an interaction between a user and an interactive electronic document, determining to record the event, identifying for the event a user action, a target element, and a set of element features, and recording data for recreating the event. Generally, the methods and systems monitor a training user's interactions with a document and generate an automated replay agent capable of replaying or recreating those interactions on the document or on similar documents. In some embodiments, the replay agent is able to place a document in a desired state and extract information from the document in the desired state. In some embodiments, the replay agent is trained to recognize elements, or types of elements, in the document.