Object Detection for Embedded Systems Using Tiny Spiking Neural Networks: Filtering Noise Through Visual Attention - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Object Detection for Embedded Systems Using Tiny Spiking Neural Networks: Filtering Noise Through Visual Attention

Résumé

Object detection is an important task becoming increasingly common in numerous applications for embedded systems. The traditional state-of-the-art deep neural networks (DNNs) tend to be incompatible with the limitations of many of those systems: their large size and high computational cost make them hard to deploy on hardware with limited resources. Spiking Neural Networks (SNNs) have been attracting attention in recent years because of their potential as energyefficient alternatives when implemented on specialized hardware, and their smooth integration with energyefficient event cameras. In this paper, we present a lightweight SNN architecture for efficient object detection in embedded systems using event camera data. We show that by applying visual attention mechanisms, we can ignore most of the noise from the input and thus reduce the number of neurons and activations since additional noise-filtering layers are not needed. Our proposed SNN is 24 times smaller than a previous similar method for our input resolution and maintains similar overall detection performances, while being more robust to noise. We finally demonstrate the energy efficiency of our network during runtime with an implementation on SpiNNaker chip, showing the applicability of our approach.
Fichier principal
Vignette du fichier
MVA2023_Submission.pdf (383.08 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04183160 , version 1 (18-08-2023)

Identifiants

  • HAL Id : hal-04183160 , version 1

Citer

Hugo Bulzomi, Amélie Gruel, Jean Martinet, Takeshi Fujita, Yuta Nakano, et al.. Object Detection for Embedded Systems Using Tiny Spiking Neural Networks: Filtering Noise Through Visual Attention. International Conference on Machine Vision and Applications (MVA), Jul 2023, Hamamatsu, Japan. ⟨hal-04183160⟩
159 Consultations
180 Téléchargements

Partager

Gmail Facebook X LinkedIn More