The Contribution of Low Frequencies to Multilingual Sub-sentential Alignment: a Differential Associative Approach - Archive ouverte HAL Access content directly
Journal Articles International Journal of Advanced Intelligence Year : 2011

The Contribution of Low Frequencies to Multilingual Sub-sentential Alignment: a Differential Associative Approach

Abstract

The goal of this paper is to show that, contrary to preconceived ideas, one can efficiently take advantage of low frequency words in natural language processing. We put them to use in sub-sentential alignment, which constitutes the first step of most data-driven machine translation systems (statistical or example-based machine translation). We show that rare words can be used as a foundation in the design of a multilingual sub-sentential alignment method, using differential techniques similar to those found in example-based machine translation. This method is truly multilingual, in that it allows the simultaneous processing of any number of languages. Moreover, it is very simple, anytime, and scales up naturally. We compare our implementation, Anymalign, with two statistical tools proven in the domain. Although its current results are on average slightly behind those of state of the art methods in phrase-based statistical machine translation, we show that the intrinsic quality of our lexicons is actually superior to that of lexicons produced by state of the art methods.
No file

Dates and versions

hal-00644800 , version 1 (25-11-2011)

Identifiers

  • HAL Id : hal-00644800 , version 1

Cite

Adrien Lardilleux, Yves Lepage, François Yvon. The Contribution of Low Frequencies to Multilingual Sub-sentential Alignment: a Differential Associative Approach. International Journal of Advanced Intelligence, 2011, 3 (2), pp.189-217. ⟨hal-00644800⟩
155 View
0 Download

Share

Gmail Facebook Twitter LinkedIn More