The Contribution of Low Frequencies to Multilingual Sub-sentential Alignment: a Differential Associative Approach - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue International Journal of Advanced Intelligence Année : 2011

The Contribution of Low Frequencies to Multilingual Sub-sentential Alignment: a Differential Associative Approach

Résumé

The goal of this paper is to show that, contrary to preconceived ideas, one can efficiently take advantage of low frequency words in natural language processing. We put them to use in sub-sentential alignment, which constitutes the first step of most data-driven machine translation systems (statistical or example-based machine translation). We show that rare words can be used as a foundation in the design of a multilingual sub-sentential alignment method, using differential techniques similar to those found in example-based machine translation. This method is truly multilingual, in that it allows the simultaneous processing of any number of languages. Moreover, it is very simple, anytime, and scales up naturally. We compare our implementation, Anymalign, with two statistical tools proven in the domain. Although its current results are on average slightly behind those of state of the art methods in phrase-based statistical machine translation, we show that the intrinsic quality of our lexicons is actually superior to that of lexicons produced by state of the art methods.
Fichier non déposé

Dates et versions

hal-00644800 , version 1 (25-11-2011)

Identifiants

  • HAL Id : hal-00644800 , version 1

Citer

Adrien Lardilleux, Yves Lepage, François Yvon. The Contribution of Low Frequencies to Multilingual Sub-sentential Alignment: a Differential Associative Approach. International Journal of Advanced Intelligence, 2011, 3 (2), pp.189-217. ⟨hal-00644800⟩
158 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More