Tagging Occitan using French and Castillan Tree Tagger - Archive ouverte HAL
Communication Dans Un Congrès Année : 2013

Tagging Occitan using French and Castillan Tree Tagger

Résumé

Part-Of-Speech (POS) tagging, including tokenization and sentence splitting, is the first step in all Natural Language Processing chain. It usually requires substantial efforts to annotate corpora and produce lexicons. However, when these language resources are missing like in Occitan, rather than concentrate the effort in creating them, methods are settled to adapt existing rich-resourced languages tagger. For this to work, these methods exploit the etymologic proximity of the under-resourced language and a rich-resourced language. In this article, we focus on Occitan, which shares similarities with several romance languages including French and Castillan. The method consists in running existing morpho-syntactic tools, here Tree Tagger, on Occitan texts with first a translation of the frequent words in a rich-resourced language. We performed two distinct experimentations, one exploiting similarities between Occitan and French and the second exploiting similarities between Occitan and Castillan. This method only requires the listing of the 300 most frequent words (based on corpus) to construct two bilingual lexicons (Occitan/French and Occitan/Castillan). Our results are better than those obtained with the Apertium tagger using a larger lexicon.

Domaines

Linguistique
Fichier principal
Vignette du fichier
ltc-111-vergezcouret.pdf (150.15 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00986426 , version 1 (02-05-2014)

Identifiants

  • HAL Id : hal-00986426 , version 1

Citer

Marianne Vergez-Couret. Tagging Occitan using French and Castillan Tree Tagger. Less Resourced Languages, new technologies, new challenges and opportunities, Dec 2013, Poznan, Poland. ⟨hal-00986426⟩
310 Consultations
446 Téléchargements

Partager

More