Grouping conversational markers across languages by exploiting large comparable corpora and unsupervised segmentation - Archive ouverte HAL
Communication Dans Un Congrès Année : 2018

Grouping conversational markers across languages by exploiting large comparable corpora and unsupervised segmentation

Résumé

This work approaches Conversational and Discourse Markers (hereafter DM) from a radical data-driven perspective grounded in large comparable corpora of French, English and Taiwan Mandarin conversations. The key features of our approach are (i) to account for lexicalization as a by-product of unsupervised segmentation applied to our corpora, (ii) to exploit simple metrics for clustering DM (both within a language and within multilingual clusters). We explore the benefits and the drawbacks of such a radical approach to DM. In particular we compare the DM clusters obtained from traditional segmentation into tokens (as given by manual transcription of the corpora) vs. unsupervised segmentation. The metrics on which we ground the clustering experiments are based on contrast between (i) short vs. longer utterances distribution and (ii) position within longer utterances.
Fichier principal
Vignette du fichier
BUCC2018(5).pdf (574.41 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01807804 , version 1 (05-06-2018)

Identifiants

  • HAL Id : hal-01807804 , version 1

Citer

Laurent Prevot, Matthieu Stali, Shu-Chuan Tseng. Grouping conversational markers across languages by exploiting large comparable corpora and unsupervised segmentation. 11th Workshop on Building and Using Comparable Corpora, May 2018, Miyazaki, Japan. ⟨hal-01807804⟩
95 Consultations
58 Téléchargements

Partager

More