Evolutionary development as a strategy for the design of artificial neural networks is an enticing idea, with possible inspiration from both biology and existing indirect representations. A growing neural network can not only optimize towards a specific goal, but can also exhibit plasticity and regeneration. Furthermore, a generative system trained in the optimization of the resultant neural network in a reinforcement learning environment has the capability of on-line learning after evolution in any reward-driven environment. In this abstract, we outline the motivation for and design of a generative system for artificial neural network design.