Towards Retail Stores Automation: 6-DOF Pose Estimation Combining Deep Learning Object Detection and Dense Depth Alignment - Archive ouverte HAL
Communication Dans Un Congrès Année : 2024

Towards Retail Stores Automation: 6-DOF Pose Estimation Combining Deep Learning Object Detection and Dense Depth Alignment

Résumé

Automating in-store logistics processes in the retail industry poses significant challenges for robot manipulators. Contrary to warehouses, retails stores are subject to customer actions, which can imply non-standard tidying of products. This paper addresses the problem of detecting, discriminating, and accurately estimating the 6 degrees-of-freedom (6-DOF) pose of individual products, even in unexpected positions such as fallen or wrongly placed objects. The trained object detection model successfully discriminated similar-shaped objects of dif- ferent brands/types commonly found in convenience stores. The detection is used to initialized the object position while several possible orientations are explored by a Fibonacci Multi-Start method. The estimated pose is then refined by a multi-scale projective Iterative Closest Point (ICP). The evaluation of the complete 6-DOF pose estimation module revealed its consistent ability to converge to the correct pose, avoiding local optima and achieving sub-millimetric precision. A working demonstration is presented, showcasing a robot rearranging a convenience store shelf. The overall system demonstrated the ability to detect fallen objects, estimate their poses, determine suitable grasping directions, and execute successful grasps. Importantly, the system’s feasibility with minimal human intervention was demonstrated, allowing easy addition of new objects by conve- nience store employees or other stakeholders.
Fichier principal
Vignette du fichier
2024_SII_Foussereau.pdf (1.65 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04306460 , version 1 (11-01-2024)

Identifiants

  • HAL Id : hal-04306460 , version 1

Citer

Virgile Foussereau, Iori Kumagai, Guillaume Caron. Towards Retail Stores Automation: 6-DOF Pose Estimation Combining Deep Learning Object Detection and Dense Depth Alignment. IEEE/SICE International Symposium on System Integration, IEEE; SICE, Jan 2024, Ha Long, Vietnam. ⟨hal-04306460⟩
218 Consultations
192 Téléchargements

Partager

More