Sequence Metric Learning as Synchronization of Recurrent Neural Networks - Archive ouverte HAL Access content directly
Conference Papers Year : 2021

Sequence Metric Learning as Synchronization of Recurrent Neural Networks


Sequence metric learning is becoming a widely adopted approach for various applications dealing with sequential multi-variate data such as activity recognition or natural language processing. It is most of the time tackled with sequence alignment approaches or representation learning. In this paper, we propose to study this subject from the point of view of dynamical system theory by drawing the analogy between synchronized trajectories produced by dynamical systems and the distance between similar sequences processed by a siamese recurrent neural network. Indeed, a siamese recurrent network comprises two identical sub-networks, two identical dynamical systems which can theoretically achieve complete synchronization if a coupling is introduced between them. We therefore propose a new neural network model that implements this coupling with a new gate integrated into the classical Gated Recurrent Unit architecture. This model is thus able to simultaneously learn a similarity metric and the synchronization of unaligned multi-variate sequences in a weakly supervised way. Our experiments show that introducing such a coupling improves the performance of the siamese Gated Recurrent Unit architecture on two datasets: one dedicated to activity recognition and another to transportation recognition.
Fichier principal
Vignette du fichier
sequence_metric_learning_compagnon.pdf (437.36 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03264242 , version 1 (18-06-2021)



Paul Compagnon, Grégoire Lefebvre, Stefan Duffner, Christophe Garcia. Sequence Metric Learning as Synchronization of Recurrent Neural Networks. International Joint Conference on Neural Networks, Jul 2021, Glasgow (virtuelle ), United Kingdom. ⟨10.1109/IJCNN52387.2021.9533627⟩. ⟨hal-03264242⟩
59 View
160 Download



Gmail Facebook X LinkedIn More