Neural Networks approaches focused on French Spoken Language Understanding: application to the MEDIA Evaluation Task - Archive ouverte HAL
Conference Papers Year : 2020

Neural Networks approaches focused on French Spoken Language Understanding: application to the MEDIA Evaluation Task

Abstract

In this paper, we present a study on a French Spoken Language Understanding (SLU) task: the MEDIA task. Many works and studies have been proposed for many tasks, but most of them are focused on English language and tasks. The exploration of a richer language like French within the framework of a SLU task implies to recent approaches to handle this difficulty. Since the MEDIA task seems to be one of the most difficult, according to several previous studies, we propose to explore Neural Networks approaches focusing of three aspects: firstly, the Neu-ral Network inputs and more specifically the word embeddings; secondly, we compared French version of BERT against the best setup through different ways; Finally, the comparison against State-of-the-Art approaches. Results show that the word embeddings trained on a small corpus need to be updated during SLU model training. Furthermore, the French BERT fine-tuned approaches outperform the classical Neural Network Architectures and achieves state of the art results. However, the contextual embeddings extracted from one of the French BERT approaches achieve comparable results in comparison to word embedding, when integrated into the proposed neural architecture.
Fichier principal
Vignette du fichier
Coling2020(3).pdf (122.65 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03007482 , version 1 (16-11-2020)

Identifiers

  • HAL Id : hal-03007482 , version 1

Cite

Sahar Ghannay, Christophe Servan, Sophie Rosset. Neural Networks approaches focused on French Spoken Language Understanding: application to the MEDIA Evaluation Task. In Proceedings of The 28th International Conference on Computational Linguistics (COLING’2020), 2020, Dec 2020, Barcelona (online), Spain. ⟨hal-03007482⟩
149 View
196 Download

Share

More