Weakly supervised discriminative training of linear models for Natural Language Processing - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2015

Weakly supervised discriminative training of linear models for Natural Language Processing

Résumé

This work explores weakly supervised training of discrimi-native linear classifiers. Such features-rich classifiers have been widely adopted by the Natural Language processing (NLP) community because of their powerful modeling capacity and their support for correlated features , which allow separating the expert task of designing features from the core learning method. However, unsupervised training of discrim-inative models is more challenging than with generative models. We adapt a recently proposed approximation of the classifier risk and derive a closed-form solution that greatly speeds-up its convergence time. This method is appealing because it provably converges towards the minimum risk without any labeled corpus, thanks to only two reasonable assumptions about the rank of class marginal and Gaussianity of class-conditional linear scores. We also show that the method is a viable , interesting alternative to achieve weakly supervised training of linear classifiers in two NLP tasks: predicate and entity recognition.
Fichier principal
Vignette du fichier
unsuplinearclasscf.pdf (388.15 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01184849 , version 1 (24-02-2019)

Identifiants

  • HAL Id : hal-01184849 , version 1

Citer

Lina Maria Rojas Barahona, Christophe Cerisara. Weakly supervised discriminative training of linear models for Natural Language Processing. 3rd International Conference on Statistical Language and Speech Processing (SLSP), Nov 2015, Budapest, Hungary. ⟨hal-01184849⟩
130 Consultations
84 Téléchargements

Partager

Gmail Facebook X LinkedIn More