Embedded neuromorphic attention model leveraging a novel low-power heterogeneous platform - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Embedded neuromorphic attention model leveraging a novel low-power heterogeneous platform

Résumé

Neuromorphic computing has been identified as an ideal candidate to exploit the potential of event-based cameras, a promising sensor for embedded computer vision. However, state-of-the-art neuromorphic models try to maximize the model performance on large platforms rather than a trade-off between memory requirements and performance. We present the first deployment of an embedded neuromorphic algorithm on Kraken, a low-power RISC-V-based SoC prototype including a neuromorphic spiking neural network (SNN) accelerator. In addition, the model employed in this paper was designed to achieve visual attention detection on event data while minimizing the neuronal populations’ size and the inference latency. Experimental results show that it is possible to achieve saliency detection in event data with a delay of 32ms, maintains classification accuracy of 84.51% and consumes only 3.85mJ per second of processed input data, achieving all of this while processing input data 10 times faster than real-time. This trade-off between decision latency, power consumption, accuracy, and run time significantly outperforms those achieved by previous implementations on CPU and neuromorphic hardware.
Fichier principal
Vignette du fichier
AICAS_2023.pdf (274.52 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04183092 , version 1 (18-08-2023)

Identifiants

Citer

Amélie Gruel, Alfio Di Mauro, Robin Hunziker, Luca Benini, Jean Martinet, et al.. Embedded neuromorphic attention model leveraging a novel low-power heterogeneous platform. International Conference on Artificial Intelligence Circuits and Systems (AICAS), Jun 2023, Hangzhou, China. pp.1-5, ⟨10.1109/AICAS57966.2023.10168603⟩. ⟨hal-04183092⟩
22 Consultations
42 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More