Realization theory of recurrent neural networks and rational systems - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2019

Realization theory of recurrent neural networks and rational systems

Résumé

In this paper, we show that, under mild assumptions, input-output behavior of a continuous-time recurrent neural network (RNN) can be represented by a rational or polynomial non-linear system. The assumptions concern the activation function of RNNs, and they are satisfied by many classical activation functions. We also present an algorithm for constructing the polynomial and rational system. This embedding of RNNs into rational systems can be useful for stability, identifiability, and realization theory for RNNs, as these problems have been studied for polynomial/rational systems. In particular, we use this embedding for deriving necessary conditions for realizability of an input-output map by RNN, and for deriving sufficient conditions for minimality of an RNN.
Fichier principal
Vignette du fichier
CDC2019_final.pdf (223.49 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-02398581 , version 1 (31-12-2020)

Identifiants

Citer

Thibault Defourneau, Mihaly Petreczky. Realization theory of recurrent neural networks and rational systems. 58th IEEE Conference on Decision and Control (CDC), Dec 2019, Nice, France. ⟨10.1109/CDC40024.2019.9029326⟩. ⟨hal-02398581⟩
72 Consultations
80 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More