A Multilingual Text Normalization Approach - Archive ouverte HAL Accéder directement au contenu
Chapitre D'ouvrage Année : 2014

A Multilingual Text Normalization Approach

Résumé

The creation of text corpora requires a sequence of processing steps in order to constitute, normalize, and then to directly exploit it by a given application. This paper presents a generic approach for text normalization and concentrates on the aspects of methodology and linguistic engineering, which serve to develop a multipurpose multilingual text corpus. This approach was applied to French, English, Spanish, Vietnamese, Khmer and Chinese. It consists in splitting the text normalization problem in a set of minor sub-problems as language-independent as possible. A set of text corpus normalization tools with linked resources and a document structuring method are proposed.
Fichier principal
Vignette du fichier
bigi2011ltc.pdf (255.52 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00983696 , version 1 (25-04-2014)

Licence

Copyright (Tous droits réservés)

Identifiants

  • HAL Id : hal-00983696 , version 1

Citer

Brigitte Bigi. A Multilingual Text Normalization Approach. Human Language Technology Challenges for Computer Science and Linguistics, 8387, Springer Berlin Heidelberg, pp. 515-526, 2014, Lecture Notes in Computer Science, 978-3-319-08957-7. ⟨hal-00983696⟩
280 Consultations
1890 Téléchargements

Partager

Gmail Facebook X LinkedIn More