One-shot Learning for Task-oriented Grasping - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Robotics and Automation Letters Année : 2023

One-shot Learning for Task-oriented Grasping

Valerija Holomjova
Andrew Starkey
Pascal Meißner

Résumé

Task-oriented grasping models aim to predict a suitable grasp pose on an object to fulfill a task. These systems have limited generalization capabilities to new tasks, but have shown the ability to generalize to novel objects by recognizing the physical properties of objects that can be associated with an action (i.e. affordances). However, this object generalization often comes at the cost of being unable to recognize the object category being grasped, which could lead to unpredictable or risky behaviors, especially within unconstrained environments. This paper overcomes these generalization limitations by exploring one-shot learning techniques to develop a task-oriented grasping solution that can leverage explicit knowledge defined in a database to implicitly generalize to new objects and tasks. We propose the One-shot Task-oriented Grasping (OS-TOG) framework, composed of four sub-models, that uses a database of objects and tasks to identify suitable task-oriented grasps on a specified object from an image scene. In physical experiments with novel objects, OS-TOG recognizes 69.4% of detected objects correctly and predicts suitable task-oriented grasps with 82.3% accuracy, having a physical grasp success rate of 82.3%. Code and models will be released upon publication.
Fichier principal
Vignette du fichier
One_shot_Learning_for_Task_oriented_Grasping.pdf (1.84 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04317959 , version 1 (01-12-2023)
hal-04317959 , version 2 (19-12-2023)

Identifiants

Citer

Valerija Holomjova, Andrew Starkey, Bruno Yun, Pascal Meißner. One-shot Learning for Task-oriented Grasping. IEEE Robotics and Automation Letters, 2023, 8 (12), pp.8232-8238. ⟨10.1109/LRA.2023.3326001⟩. ⟨hal-04317959v2⟩
76 Consultations
47 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More