Cross-Modal Attention for Accurate Pedestrian Trajectory Prediction - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Cross-Modal Attention for Accurate Pedestrian Trajectory Prediction

Résumé

Accurately predicting human behavior is essential for a variety of applications, including self-driving cars, surveillance systems, and social robots. However, predicting human movement is challenging due to the complexity of physical environments and social interactions. Most studies focus on static environmental information, while ignoring the dynamic visual information available in the scene. To address this issue, we propose a novel approach called Cross-Modal Attention Trajectory Prediction (CMATP) able to predict human paths based on observed trajectory and dynamic scene context. Our approach uses a bimodal transformer network to capture complex spatio-temporal interactions and incorporates both pedestrian trajectory data and contextual information. Our approach achieves state-of-the-art performance on three real-world pedestrian prediction datasets, making it a promising solution for improving the safety and reliability of pedestrian detection and tracking systems. The code to reproduce our results is available at this link.
Fichier principal
Vignette du fichier
BMVC 2023 Submission_467.pdf (1.12 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04448852 , version 1 (13-02-2024)

Identifiants

  • HAL Id : hal-04448852 , version 1

Citer

Mayssa Zaier, Hazem Wannous, Hassen Drira, Jacques Boonaert. Cross-Modal Attention for Accurate Pedestrian Trajectory Prediction. 34th British Machine Vision Conference 2023, Nov 2023, Aberdeen, United Kingdom. ⟨hal-04448852⟩
31 Consultations
59 Téléchargements

Partager

Gmail Mastodon Facebook X LinkedIn More