Deformation Control of a 3D Soft Object using RGB-D Visual Servoing and FEM-based Dynamic Model - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Robotics and Automation Letters Année : 2024

Deformation Control of a 3D Soft Object using RGB-D Visual Servoing and FEM-based Dynamic Model

Résumé

In this letter, we present a visual control framework for accurately positioning feature points belonging to the surface of a 3D deformable object to desired 3D positions, by acting on a set of manipulated points using a robotic manipulator. Notably, our framework considers the dynamic behavior of the object deformation, that is, we do not assume that the object is in its static equilibrium during the manipulation. By relying on a coarse dynamic Finite Element Model (FEM), we have successfully formulated the analytical relationship expressing the motion of the feature points to the six degrees of freedom (6 DOF) motion of a robot gripper. From this modeling step, a novel closed-loop deformation controller is designed. To be robust against model approximations, the whole shape of the object is tracked in real-time using an RGB-D camera, thus allowing to correct any drift between the object and its model on-the-fly. Our model-based and vision-based controller has been validated in real experiments. The results highlight the effectiveness of the proposed methodology.
Fichier principal
Vignette du fichier
RAL_Paper_Mandela_Ouafo_Fonkoua_final.pdf (7.43 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04622538 , version 1 (24-06-2024)

Identifiants

Citer

Mandela Ouafo Fonkoua, François Chaumette, Alexandre Krupa. Deformation Control of a 3D Soft Object using RGB-D Visual Servoing and FEM-based Dynamic Model. IEEE Robotics and Automation Letters, 2024, 9 (8), pp.6943-6950. ⟨10.1109/LRA.2024.3416801⟩. ⟨hal-04622538⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More