Compilation of specialized comparable corpus in French and Japanese - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2009

Compilation of specialized comparable corpus in French and Japanese

Résumé

We present in this paper the development of a specialized comparable corpora compilation tool, for which quality would be close to a manually compiled corpus. The comparability is based on three levels: domain, topic and type of discourse. Domain and topic can be filtered with the keywords used through web search. But the detection of the type of discourse needs a wide linguistic analysis. The first step of our work is to automate the detection of the type of discourse that can be found in a scientific domain (science and popular science) in French and Japanese languages. First, a contrastive stylistic analysis of the two types of discourse is done on both languages. This analysis leads to the creation of a reusable, generic and robust typology. Machine learning algorithms are then applied to the typology, using shallow parsing. We obtain good results, with an average precision of 80% and an average recall of 70% that demonstrate the efficiency of this typology. This classification tool is then inserted in a corpus compilation tool which is a text collection treatment chain realized through IBM \texttt{UIMA} system. Starting from two specialized web documents collection in French and Japanese, this tool creates the corresponding corpus.
Fichier non déposé

Dates et versions

hal-00411258 , version 1 (26-08-2009)

Identifiants

  • HAL Id : hal-00411258 , version 1

Citer

Lorraine Goeuriot, Béatrice Daille, Emmanuel Morin. Compilation of specialized comparable corpus in French and Japanese. ACL-IJCNLP workshop “Building and Using Comparable Corpora” (BUCC 2009), Aug 2009, Singapore. pp.55-63. ⟨hal-00411258⟩
75 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More