A system, such as a system of a computing resource service provider, detects changes to a pipeline template package that encodes information associated with application code and infrastructure that may be utilized as part of deploying the application code in stages of a pipeline. An infrastructure template that is usable to provision an execution environment may be generated for a corresponding stage of the development, and may be utilized as part of a process for provisioning an execution environment which may, for example, run tests to verify the quality of the application code.