Discriminating between Similar Languages using Weighted Subword Features - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2017

Discriminating between Similar Languages using Weighted Subword Features

Résumé

The present contribution revolves around a contrastive subword n-gram model which has been tested in the Discriminating between Similar Languages shared task. I present and discuss the method used in this 14-way language identification task comprising varieties of 6 main language groups. It features the following characteristics: (1) the preprocessing and conversion of a collection of documents to sparse features; (2) weighted character n-gram profiles; (3) a multinomial Bayesian classifier. Meaningful bag-of-n-grams features can be used as a system in a straightforward way, my approach outperforms most of the systems used in the DSL shared task (3rd rank).
Fichier principal
Vignette du fichier
ABarbaresi_Weighted-Subword-Features_DSL17.pdf (117.02 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01575656 , version 1 (21-08-2017)

Identifiants

Citer

Adrien Barbaresi. Discriminating between Similar Languages using Weighted Subword Features. Fourth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial 2017), Association for Computational Linguistics (ACL), Apr 2017, Valence, Spain. pp.184-189, ⟨10.18653/v1/W17-1223⟩. ⟨hal-01575656⟩
87 Consultations
207 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More