Generalizing sampling-based multilingual alignment

Adrien Lardilleux, François Yvon, Yves Lepage

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Sub-sentential alignment is the process by which multi-word translation units are extracted from sentence-aligned multilingual parallel texts. This process is required, for instance, in the course of training statistical machine translation systems. Standard approaches typically rely on the estimation of several probabilistic models of increasing complexity and on the use of various heuristics, that make it possible to align, first isolated words, then, by extension, groups of words. In this paper, we explore an alternative approach which relies on a much simpler principle: the comparison of occurrence profiles in sub-corpora obtained by sampling. After analyzing the strengths and weaknesses of this approach, we show how to improve the detection of multi-word translation units and evaluate these improvements on machine translation tasks.

Original languageEnglish
Pages (from-to)1-23
Number of pages23
JournalMachine Translation
Volume27
Issue number1
DOIs
Publication statusPublished - 2013 Mar 1

    Fingerprint

Keywords

  • Association measures
  • Phrase-based machine translation
  • Sub-sentential alignment

ASJC Scopus subject areas

  • Software
  • Language and Linguistics
  • Linguistics and Language
  • Artificial Intelligence

Cite this