Search for Novelty is an universal method of biological life evolution through introduction of the random beneficial mutations to the genetic code of the organism. In this work we describe experiment of applying Novelty Search method of fitness function optimization combined with Neuro-Evolution of Augmented Topologies (NEAT) algorithm to produce Autonomous Artificial Intelligent Agents capable to solve spatial navigation task in complex maze environment. The AI Agents produced by the neuro-evolution method described by the NEAT algorithm evolve through gradual complexification of their internal neural network by augmenting its topologies. Finally, we consider how to apply studied optimization methods and evolutionary algorithms to create ensembles of compact modular AI systems trained using vocabulary of terms describing real world settings. And how to control such ensembles by specialized supervisors knowledgeable about the task and the operating environment. We provide the complete source code for implementing the NEAT algorithm, including Novelty Search and Objective-Based optimization methods, in the GO programming language.