Quaternion Denoising Encoder-Decoder for Theme Identification of Telephone Conversations - Archive ouverte HAL
Communication Dans Un Congrès Année : 2017

Quaternion Denoising Encoder-Decoder for Theme Identification of Telephone Conversations

Mohamed Morchid
Georges Linarès

Résumé

In the last decades, encoder-decoders or autoencoders (AE) have received a great interest from researchers due to their capability to construct robust representations of documents in a low dimensional subspace. Nonetheless, autoencoders reveal little in way of spoken document internal structure by only considering words or topics contained in the document as an isolate basic element, and tend to overfit with small corpus of documents. Therefore, Quaternion Multi-layer Perceptrons (QMLP) have been introduced to capture such internal latent dependencies , whereas denoising autoencoders (DAE) are composed with different stochastic noises to better process small set of documents. This paper presents a novel autoencoder based on both hitherto-proposed DAE (to manage small corpus) and the QMLP (to consider internal latent structures) called "Quater-nion denoising encoder-decoder" (QDAE). Moreover, the paper defines an original angular Gaussian noise adapted to the speci-ficity of hyper-complex algebra. The experiments, conduced on a theme identification task of spoken dialogues from the DE-CODA framework, show that the QDAE obtains the promising gains of 3% and 1.5% compared to the standard real valued de-noising autoencoder and the QMLP respectively.
Fichier principal
Vignette du fichier
0a47312b0c016633a9865255d8b2e6c9647e.pdf (233.41 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02107632 , version 1 (23-04-2019)

Identifiants

Citer

Titouan Parcollet, Mohamed Morchid, Georges Linarès. Quaternion Denoising Encoder-Decoder for Theme Identification of Telephone Conversations. Interspeech 2017, Aug 2017, Stockholm, Sweden. pp.3325-3328, ⟨10.21437/Interspeech.2017-1029⟩. ⟨hal-02107632⟩

Collections

UNIV-AVIGNON LIA
124 Consultations
286 Téléchargements

Altmetric

Partager

More