Behavioral Repertoire via Generative Adversarial Policy Networks - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Cognitive and Developmental Systems Année : 2022

Behavioral Repertoire via Generative Adversarial Policy Networks

Marija Jegorova
Timothy Hospedales

Résumé

Learning algorithms are enabling robots to solve increasingly challenging real-world tasks. These approaches often rely on demonstrations and reproduce the behavior shown. Unexpected changes in the environment may require using different behaviors to achieve the same effect, for instance to reach and grasp an object in changing clutter. An emerging paradigm addressing this robustness issue is to learn a diverse set of successful behaviors for a given task, from which a robot can select the most suitable policy when faced with a new environment. In this paper, we explore a novel realization of this vision by learning a generative model over policies. Rather than learning a single policy, or a small fixed repertoire, our generative model for policies compactly encodes an unbounded number of policies and allows novel controller variants to be sampled. Leveraging our generative policy network, a robot can sample novel behaviors until it finds one that works for a new environment. We demonstrate this idea with an application of robust ball-throwing in the presence of obstacles. We show that this approach achieves a greater diversity of behaviors than an existing evolutionary approach, while maintaining good efficacy of sampled behaviors, allowing a Baxter robot to hit targets more often when ball throwing in the presence of obstacles.
Fichier principal
Vignette du fichier
1811.02945.pdf (531.68 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03992639 , version 1 (16-02-2023)

Identifiants

Citer

Marija Jegorova, Stephane Doncieux, Timothy Hospedales. Behavioral Repertoire via Generative Adversarial Policy Networks. IEEE Transactions on Cognitive and Developmental Systems, 2022, 14 (4), pp.1344-1355. ⟨10.1109/TCDS.2020.3008574⟩. ⟨hal-03992639⟩
19 Consultations
19 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More