Classifying Sluice Occurrences in Dialogue - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2018

Classifying Sluice Occurrences in Dialogue

Austin Baird
  • Fonction : Auteur
Daniel Hardt
  • Fonction : Auteur

Résumé

Ellipsis is an important challenge for natural language processing systems, and addressing that challenge requires large collections of relevant data. The dataset described by Anand and McCloskey (2015), consisting of 4100 occurrences, is an important step towards addressing this issue. However, many NLP technologies require much larger collections of data. Furthermore, previous collections of ellipsis are primarily restricted to news data, although sluicing presents a particularly important challenge for dialogue systems. In this paper we classify sluices as Direct, Reprise, Clarification. We perform manual annotation with acceptable inter-coder agreement. We build classifier models with Decision Trees and Naive Bayes, with accuracy of 67%. We deploy a classifier to automatically classify sluice occurrences in OpenSubtitles, resulting in a corpus with 1.7 million occurrences. This will support empirical research into sluicing in dialogue, and it will also make it possible to build NLP systems using very large datasets. This is a noisy dataset; based on a small manually annotated sample, we found that only 80% of instances are in fact sluices, and the accuracy of sluice classification is lower. Despite this, the corpus can be of great use in research on sluicing and development of systems, and we are making the corpus freely available on request. Furthermore, we are in the process of improving the accuracy of sluice identification and annotation for the purpose of created a subsequent version of this corpus.

Mots clés

Domaines

Linguistique
Fichier principal
Vignette du fichier
AH&DH.pdf (95.49 Ko) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-03833287 , version 1 (22-11-2022)

Identifiants

  • HAL Id : hal-03833287 , version 1

Citer

Austin Baird, Anissa Hamza-Jamann, Daniel Hardt. Classifying Sluice Occurrences in Dialogue. Eleventh International Conference on Language Resources and Evaluation (LREC 2018), May 2018, Miyazaki, Japan. ⟨hal-03833287⟩

Collections

SITE-ALSACE
35 Consultations
7 Téléchargements

Partager

Gmail Mastodon Facebook X LinkedIn More