Human action recognition with a large-scale brain-inspired photonic computer - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Nature Machine Intelligence Année : 2019

Human action recognition with a large-scale brain-inspired photonic computer

Résumé

The recognition of human actions in video streams is a challenging task in computer vision, with cardinal applications in e.g. brain-computer interface and surveillance. Deep learning has shown remarkable results recently, but can be found hard to use in practice, as its training requires large datasets and special purpose, energy-consuming hardware. In this work, we propose a photonic hardware approach. Our experimental setup comprises off-the-shelf components and implements an easy-to-train recurrent neural network with 16,384 nodes, scalable up to hundreds of thousands of nodes. The system, based on the reservoir computing paradigm, is trained to recognise six human actions from the KTH video database using either raw frames as inputs, or a set of features extracted with the histograms of oriented gradients algorithm. We report a classification accuracy of 91.3%, comparable to state-of-the-art digital implementations, while promising a higher processing speed in comparison to the existing hardware approaches. Because of the massively parallel processing capabilities offered by photonic architectures, we anticipate that this work will pave the way towards simply reconfigurable and energy-efficient solutions for real-time video processing.
Fichier principal
Vignette du fichier
antonik2019human_hal-02366976.pdf (1.03 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02366976 , version 1 (28-04-2020)

Identifiants

Citer

Piotr Antonik, Nicolas Marsal, Daniel Brunner, Damien Rontani. Human action recognition with a large-scale brain-inspired photonic computer. Nature Machine Intelligence, 2019, 1 (11), pp.530-537. ⟨10.1038/s42256-019-0110-8⟩. ⟨hal-02366976⟩
256 Consultations
295 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More