Weak Supervision for Learning Discourse Structure - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2019

Weak Supervision for Learning Discourse Structure

Résumé

This paper provides a detailed comparison of a data programming approach with (i) off-the-shelf, state-of-the-art deep learning architectures that optimize their representations (BERT) and (ii) handcrafted-feature approaches previously used in the discourse analysis literature. We compare these approaches on the task of learning discourse structure for multi-party dialogue. The data programming paradigm offered by the Snorkel framework allows a user to label training data using expert-composed heuristics, which are then transformed via the "generative step" into probability distributions of the class labels given the data. We show that on our task the generative model outperforms both deep learning architectures as well as more traditional ML approaches when learning discourse structure-it even outperforms the combination of deep learning methods and hand-crafted features. We also implement several strategies for "decoding" our generative model output in order to improve our results. We conclude that weak supervision methods hold great promise as a means for creating and improving data sets for discourse structure.
Fichier principal
Vignette du fichier
EMNLP2019_Templates(2).pdf (433.48 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02393459 , version 1 (04-12-2019)

Identifiants

  • HAL Id : hal-02393459 , version 1

Citer

Sonia Badene, Kate Thompson, Jean-Pierre Lorré, Nicholas Asher. Weak Supervision for Learning Discourse Structure. EMNLP, Nov 2019, Hong Kong, China. ⟨hal-02393459⟩
213 Consultations
156 Téléchargements

Partager

Gmail Facebook X LinkedIn More