Systems and processes for creating and updating natural language models are provided. An example process of creating a natural language model includes, at an electronic device with one or more processors and memory, receiving an utterance, associating an action structure with the utterance, determining a plurality of augmented utterances based on the received utterance, creating a natural language model including the received utterance and the plurality of augmented utterances by mapping the plurality of augmented utterance to the associated action structure, and providing the natural language model including the received utterance and the plurality of augmented utterances to a second electronic device.