ALSO: Automotive Lidar Self-supervision by Occupancy estimation - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

ALSO: Automotive Lidar Self-supervision by Occupancy estimation

Résumé

We propose a new self-supervised method for pre-training the backbone of deep perception models operating on point clouds. The core idea is to train the model on a pretext task which is the reconstruction of the surface on which the 3D points are sampled, and to use the underlying latent vectors as input to the perception head. The intuition is that if the network is able to reconstruct the scene surface, given only sparse input points, then it probably also captures some fragments of semantic information, that can be used to boost an actual perception task. This principle has a very simple formulation, which makes it both easy to implement and widely applicable to a large range of 3D sensors and deep networks performing semantic segmentation or object detection. In fact, it supports a single-stream pipeline, as opposed to most contrastive learning approaches, allowing training on limited resources. We conducted extensive experiments on various autonomous driving datasets, involving very different kinds of lidars, for both semantic segmentation and object detection. The results show the effectiveness of our method to learn useful representations without any annotation, compared to existing approaches. The code is available at github.com/valeoai/ALSO
Fichier principal
Vignette du fichier
Boulch_ALSO_Automotive_Lidar_Self-Supervision_by_Occupancy_Estimation_CVPR_2023_paper.pdf (2.06 Mo) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-04496512 , version 1 (08-03-2024)

Identifiants

Citer

Alexandre Boulch, Corentin Sautier, Björn Michele, Gilles Puy, Renaud Marlet. ALSO: Automotive Lidar Self-supervision by Occupancy estimation. 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2023), Jun 2023, Vancouver, Canada. pp.13455-13465, ⟨10.1109/CVPR52729.2023.01293⟩. ⟨hal-04496512⟩
26 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More