Communication Dans Un Congrès Année : 2025

Facilitate and scale up the creation of 3D meshes, 6D category-based datasets and grasping with generative models: genvegefruits3d

Résumé

Despite significant advances in 2D image, enabled by foundation models, progress in 3D understanding, particularly in 6D pose estimation and shape reconstruction, remains limited by the scarcity of datasets. In particular, in category 6D pose estimation, the high costs of real-world data collection have resulted in datasets with restricted categories, low diversity, and minimal instance variability. Recent methods have attempted to address this gap by leveraging synthetic image generation tools. However, these approaches are constrained by the limitations of available mesh datasets, which hinder the diversity, scalability, and inclusion of novel objects in generated samples. In this work, we propose a first automatic pipeline for the large-scale generation of 3D category-based datasets. Our approach uses 3D generative models guided by textual input to produce diverse and scalable datasets. To demonstrate its efficacy, we generated a new dataset named GenVegeFruits3D comprising 100 categories of fruits and vegetables, each containing over 1000 unique meshes. This significantly enhances the scale and diversity of existing category-based 3D datasets while reducing reliance on pre-existing 3D meshes. Additionally, we trained a 3D generative model, a 3D understanding model, and a grasping model, including on a real robotic setup. The dataset and code are available at: https://datasets.liris.cnrs.fr/genvegefruits3d-version1.

Fichier principal
Vignette du fichier
ICIP2025-12.pdf (38.71 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-04995939 , version 1 (18-03-2025)
hal-04995939 , version 2 (03-07-2025)

Licence

Identifiants

  • HAL Id : hal-04995939 , version 2

Citer

Guillaume Duret, Younes Bourennane, Danylo Mazurak, Anna Samsonenko, Florence Zara, et al.. Facilitate and scale up the creation of 3D meshes, 6D category-based datasets and grasping with generative models: genvegefruits3d. IEEE 2025 International Conference on Image Processing (ICIP 2025), Sep 2025, Anchorage, AL, United States. ⟨hal-04995939v2⟩
1814 Consultations
354 Téléchargements

Partager

  • More