Chapitre D'ouvrage Année : 2014

A Multilingual Text Normalization Approach

Résumé

The creation of text corpora requires a sequence of processing steps in order to constitute, normalize, and then to directly exploit it by a given application. This paper presents a generic approach for text normalization and concentrates on the aspects of methodology and linguistic engineering, which serve to develop a multipurpose multilingual text corpus. This approach was applied to French, English, Spanish, Vietnamese, Khmer and Chinese. It consists in splitting the text normalization problem in a set of minor sub-problems as language-independent as possible. A set of text corpus normalization tools with linked resources and a document structuring method are proposed.

Fichier principal
Vignette du fichier
bigi2011ltc.pdf (255.52 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence
Loading...

Dates et versions

hal-00983696 , version 1 (25-04-2014)

Licence

Identifiants

  • HAL Id : hal-00983696 , version 1

Citer

Brigitte Bigi. A Multilingual Text Normalization Approach. Human Language Technology Challenges for Computer Science and Linguistics, 8387, Springer Berlin Heidelberg, pp. 515-526, 2014, Lecture Notes in Computer Science, 978-3-319-08957-7. ⟨hal-00983696⟩
555 Consultations
2498 Téléchargements

Partager

  • More