A system and method for augmenting video displayed via web browser to add interactive functionality is disclosed. Elements are included in a structured media definition to cause the video player to instantiate one or more new elements on a webpage when the media is played, including a first script that includes instructions to generate an interactive menu and second script, such that selection of an option from the interactive menu will call one or more application programming interface (API) functions of the second script. The structured media definition causes loading of the video and execution of the instructions. A server backend receives and processes API calls from the second script and transmits responses to the API calls to be acted upon by the second script.