We present a framework for interactive generation of musical sequences combining generative agents and computer-assisted composition tools. The proposed model enables guiding corpus-based generative processes through explicit specifications of temporal structures, or using another layer of generative models trained on a corpus of structures. This paper highlights the foundation and extensions of this approach, details its implementation in the OpenMusic/om visual programming environments, and presents some applications in musical productions.