Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for natural language control of web browsers. The methods, systems, and apparatus include actions of obtaining a query from a user, determining a likely intent and an entity from the query, determining an action and script metadata based on the likely intent and the entity, compiling scripts based on the action and the script metadata, and providing the scripts to a web browser for execution.