A trained recurrent neural network having a set of control policies learned from application of a template dataset and one or more corresponding template deep network architectures may generate a deep network architecture for performing a task on an application dataset. The template deep network architectures may have an established level or performance in executing the task. A deep network based on the deep network architecture may trained to perform the task on the application dataset. The control policies of the recurrent neural network may be updated based on the performance of the trained deep network.