Outdoor Navigation Assistive System Based on Robust and Real-Time Visual–Auditory Substitution Approach - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Sensors Année : 2023

Outdoor Navigation Assistive System Based on Robust and Real-Time Visual–Auditory Substitution Approach

Résumé

Blindness affects millions of people worldwide, leading to difficulties in daily travel and a loss of independence due to a lack of spatial information. This article proposes a new navigation aid to help people with severe blindness reach their destination. Blind people are guided by a short 3D spatialised sound that indicates the target point to follow. This sound is combined with other sonified information on potential obstacles in the vicinity. The proposed system is based on inertial sensors, GPS data, and the cartographic knowledge of pedestrian paths to define the trajectory. In addition, visual clues are used to refine the trajectory with ground floor information and obstacle information using a camera to provide 3D spatial information. The proposed method is based on a deep learning approach. The different neural networks used in this approach are evaluated on datasets that regroup navigations from pedestrians’ point-of-view. This method achieves low latency and real-time processing without relying on remote connections, instead using a low-power embedded GPU target and a multithreaded approach for video processing, sound generation, and acquisition. This system could significantly improve the quality of life and autonomy of blind people, allowing them to reliably and efficiently navigate in their environment.
Fichier principal
Vignette du fichier
sensors-24-00166-v2.pdf (8.55 Mo) Télécharger le fichier
Origine : Publication financée par une institution

Dates et versions

hal-04440811 , version 1 (28-03-2024)

Identifiants

Citer

Florian Scalvini, Camille Bordeau, Maxime Ambard, Cyrille Migniot, Julien Dubois. Outdoor Navigation Assistive System Based on Robust and Real-Time Visual–Auditory Substitution Approach. Sensors, 2023, 24 (1), pp.166. ⟨10.3390/s24010166⟩. ⟨hal-04440811⟩
17 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More