Fusion of Semantic Segmentation Models for Vehicle Perception Tasks - Archive ouverte HAL
Communication Dans Un Congrès Année : 2024

Fusion of Semantic Segmentation Models for Vehicle Perception Tasks

Résumé

In self-navigation problems for autonomous vehicles, the variability of environmental conditions, complex scenes with vehicles and pedestrians, and the high-dimensional or real-time nature of tasks make segmentation challenging. Sensor fusion can representatively improve performances. Thus, this work highlights a late fusion concept used for semantic segmentation tasks in such perception systems. It is based on two approaches for merging information coming from two neural networks, one trained for camera data and one for LiDAR frames. The first approach involves fusing probabilities along with calculating partial conflicts and redistributing data. The second technique focuses on making individual decisions based on sources and fusing them later with weighted Shannon entropies. The two segmentation models are trained and evaluated on a particular KITTI semantic dataset. In the realm of multi-class segmentation tasks, the two fusion techniques are compared and evaluated with illustrative examples. Intersection over union metric and quality of decision are computed to assess the performance of each methodology.
Fichier principal
Vignette du fichier
DTIS2024-162-Fusion 2024 - FSSM for vehicle perception - postprint-Publiée.pdf (3.57 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04724310 , version 1 (07-10-2024)

Identifiants

  • HAL Id : hal-04724310 , version 1

Citer

Danut-Vasile Giurgi, Jean Dezert, Thomas Josso-Laurain, Maxime Devanne, Jean-Philippe Lauffenburger. Fusion of Semantic Segmentation Models for Vehicle Perception Tasks. Fusion 2024, Jul 2024, Venise, Italy. ⟨hal-04724310⟩
35 Consultations
18 Téléchargements

Partager

More