STAF: Spatio-Temporal Attention Framework for Understanding Road Agents Behaviors - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Access Année : 2022

STAF: Spatio-Temporal Attention Framework for Understanding Road Agents Behaviors

Résumé

On-road behavior analysis is a key task required for robust autonomous vehicles. Unlike traditional perception tasks, this paper aims to achieve a high-level understanding of road agent activities. This allows better operation under challenging contexts to enable better interaction and decision-making in such complex environments. In this paper, we tackle the problem of discriminating spatio-temporal features that capture the visual instants that require more attention. We propose a new approach called STAF (Spatio-Temporal Attention Framework) through Long Short Term Memory (LSTM) layers that uses a multi-head attention mechanism on its past cell state to focus on attributes that are relevant over time. Experiments have been carried out on two different scenarios over data from Joint Attention in Autonomous Driving (JAAD) and Honda Research Institute Driving Dataset (HDD), both datasets devoted to understanding the behavior of road agents. The evaluation and results obtained proof that the proposed “STAF” is outperforming state-of-the-art algorithms-based LSTM (Ramanishka, Rasouli, and LSTM-baseline). For example, STAF outperforms LSTM with mean Average Precision (mAP) of 13%.

Dates et versions

hal-04097562 , version 1 (15-05-2023)

Licence

Paternité

Identifiants

Citer

R. Trabelsi, R. Khemmar, Benoit Decoux, J.-Y. Ertaud, R. Boutteau. STAF: Spatio-Temporal Attention Framework for Understanding Road Agents Behaviors. IEEE Access, 2022, 10, pp.55794-55804. ⟨10.1109/ACCESS.2022.3176861⟩. ⟨hal-04097562⟩
20 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More