Prescient Teleoperation of Humanoid Robots - Archive ouverte HAL
Communication Dans Un Congrès Année : 2023

Prescient Teleoperation of Humanoid Robots

Résumé

Teleoperated humanoid robots are ideally suited to act as human avatars in remote environments. Unfortunately, their deployment is hindered by the communication delays between the human input and the video feedback from the robot. Here, we introduce a direct teleoperation system in which the operator receives a synchronized video feed of real images, even when the communication channel imposes a 1 to 2-second delay. Our key idea is to leverage machine learning to allow the robot to execute commands before the operator performs them, so that the operator receives a delayed video stream that is almost indistinguishable from real-time feedback. In our experiments, the iCub humanoid robot (32 degrees of freedom) was successfully controlled to perform several wholebody manipulation tasks, including reaching different targets, picking up an object, and moving a box. This new technique may enable real-life avatars on long-range radio networks, from remote maintenance to space missions.
Fichier principal
Vignette du fichier
main_1030.pdf (21.73 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04265528 , version 1 (30-10-2023)

Licence

Identifiants

Citer

Luigi Penco, Jean-Baptiste Mouret, Serena Ivaldi. Prescient Teleoperation of Humanoid Robots. 2023 IEEE RAS International Conference on Humanoid Robots, Dec 2023, Austin, United States. ⟨10.1109/Humanoids57100.2023.10375166⟩. ⟨hal-04265528⟩
206 Consultations
81 Téléchargements

Altmetric

Partager

More