Lexical Normalization of Spanish Tweets with Rule-Based Components and Language Models - Archive ouverte HAL
Article Dans Une Revue Procesamiento del Lenguaje Natural Année : 2014

Lexical Normalization of Spanish Tweets with Rule-Based Components and Language Models

Montse Cuadros
  • Fonction : Auteur
  • PersonId : 962765
Thierry Etchegoyhen
  • Fonction : Auteur
  • PersonId : 962766

Résumé

This paper presents a system to normalize Spanish tweets, which uses preprocessing rules, a domain-appropriate edit-distance model, and language models to select correction candidates based on context. The system is an improvement on the tool we submitted to the Tweet-Norm 2013 shared task, and results on the task's test-corpus are above-average. Additionally, we provide a study of the impact for tweet normalization of the different components of the system: rule-based, edit-distance based and statistical.
Fichier principal
Vignette du fichier
4902-4167-1-PB.pdf (870.62 Ko) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte
Loading...

Dates et versions

hal-01099241 , version 1 (01-01-2015)

Identifiants

  • HAL Id : hal-01099241 , version 1

Citer

Pablo Ruiz, Montse Cuadros, Thierry Etchegoyhen. Lexical Normalization of Spanish Tweets with Rule-Based Components and Language Models. Procesamiento del Lenguaje Natural, 2014, pp.8. ⟨hal-01099241⟩
150 Consultations
180 Téléchargements

Partager

More