Layered Controller Synthesis for Dynamic Multi-agent Systems - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Layered Controller Synthesis for Dynamic Multi-agent Systems

Résumé

In this paper we present a layered approach for multi-agent control problem, decomposed into three stages, each building upon the results of the previous one. First, a high-level plan for a coarse abstraction of the system is computed, relying on parametric timed automata augmented with stopwatches as they allow to efficiently model simplified dynamics of such systems. In the second stage, the high-level plan, based on SMT-formulation, mainly handles the combinatorial aspects of the problem, provides a more dynamically accurate solution. These stages are collectively referred to as the SWA-SMT solver. They are correct by construction but lack a crucial feature: they cannot be executed in real time. To overcome this, we use SWA-SMT solutions as the initial training dataset for our last stage, which aims at obtaining a neural network control policy. We use reinforcement learning to train the policy, and show that the initial dataset is crucial for the overall success of the method.

Dates et versions

hal-04237998 , version 1 (11-10-2023)

Identifiants

Citer

Emily Clement, Nicolas Perrin-Gilbert, Philipp Schlehuber-Caissier. Layered Controller Synthesis for Dynamic Multi-agent Systems. International Conference on Formal Modeling and Analysis of Timed Systems (FORMATS 2023), Sep 2023, Antwerp, Belgium. pp.50-68, ⟨10.1007/978-3-031-42626-1_4⟩. ⟨hal-04237998⟩
24 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More