Improving the distribution of N-grams in phrase tables obtained by the sampling-based method

Juan Luo; Adrien Lardilleux; Yves Lepage

doi:10.1007/978-3-319-08958-4_34

Improving the distribution of N-grams in phrase tables obtained by the sampling-based method

Juan Luo, Adrien Lardilleux, Yves Lepage

Graduate School of Information, Production and Systems

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

We describe an approach to improve the performance of sampling-based sub-sentential alignment method on translation tasks by investigating the distribution of n-grams in the phrase tables. This approach consists in enforcing the alignment of n-grams. We compare the quality of phrase translation tables output by this approach and that of the state-of-the-art estimation approach in statistical machine translation tasks. We report significant improvements for this approach and show that merging phrase tables outperforms the state-of-the-art techniques.

Original language	English
Title of host publication	Human Language Technology Challenges for Computer Science and Linguistics - 5th Language and Technology Conference, LTC 2011, Revised Selected Papers
Publisher	Springer Verlag
Pages	419-431
Number of pages	13
ISBN (Print)	9783319089577
DOIs	https://doi.org/10.1007/978-3-319-08958-4_34
Publication status	Published - 2014 Jan 1
Event	5th Language and Technology Conference, LTC 2011 - Poznan, Poland Duration: 2011 Nov 25 → 2011 Nov 27

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	8387 LNAI
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	5th Language and Technology Conference, LTC 2011
Country	Poland
City	Poznan
Period	11/11/25 → 11/11/27

Keywords

Statistical machine translation
Sub-sentential alignment

ASJC Scopus subject areas

Theoretical Computer Science
Computer Science(all)

Access to Document

10.1007/978-3-319-08958-4_34

Fingerprint Dive into the research topics of 'Improving the distribution of N-grams in phrase tables obtained by the sampling-based method'. Together they form a unique fingerprint.

Cite this

Luo, J., Lardilleux, A., & Lepage, Y. (2014). Improving the distribution of N-grams in phrase tables obtained by the sampling-based method. In Human Language Technology Challenges for Computer Science and Linguistics - 5th Language and Technology Conference, LTC 2011, Revised Selected Papers (pp. 419-431). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8387 LNAI). Springer Verlag. https://doi.org/10.1007/978-3-319-08958-4_34

Improving the distribution of N-grams in phrase tables obtained by the sampling-based method. / Luo, Juan; Lardilleux, Adrien; Lepage, Yves.

Human Language Technology Challenges for Computer Science and Linguistics - 5th Language and Technology Conference, LTC 2011, Revised Selected Papers. Springer Verlag, 2014. p. 419-431 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8387 LNAI).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Luo, J, Lardilleux, A & Lepage, Y 2014, Improving the distribution of N-grams in phrase tables obtained by the sampling-based method. in Human Language Technology Challenges for Computer Science and Linguistics - 5th Language and Technology Conference, LTC 2011, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 8387 LNAI, Springer Verlag, pp. 419-431, 5th Language and Technology Conference, LTC 2011, Poznan, Poland, 11/11/25. https://doi.org/10.1007/978-3-319-08958-4_34

Luo J, Lardilleux A, Lepage Y. Improving the distribution of N-grams in phrase tables obtained by the sampling-based method. In Human Language Technology Challenges for Computer Science and Linguistics - 5th Language and Technology Conference, LTC 2011, Revised Selected Papers. Springer Verlag. 2014. p. 419-431. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-08958-4_34

Luo, Juan ; Lardilleux, Adrien ; Lepage, Yves. / Improving the distribution of N-grams in phrase tables obtained by the sampling-based method. Human Language Technology Challenges for Computer Science and Linguistics - 5th Language and Technology Conference, LTC 2011, Revised Selected Papers. Springer Verlag, 2014. pp. 419-431 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{592b93620a344b19ab77ba8dc00ceeae,

title = "Improving the distribution of N-grams in phrase tables obtained by the sampling-based method",

abstract = "We describe an approach to improve the performance of sampling-based sub-sentential alignment method on translation tasks by investigating the distribution of n-grams in the phrase tables. This approach consists in enforcing the alignment of n-grams. We compare the quality of phrase translation tables output by this approach and that of the state-of-the-art estimation approach in statistical machine translation tasks. We report significant improvements for this approach and show that merging phrase tables outperforms the state-of-the-art techniques.",

keywords = "Statistical machine translation, Sub-sentential alignment",

author = "Juan Luo and Adrien Lardilleux and Yves Lepage",

year = "2014",

month = jan,

day = "1",

doi = "10.1007/978-3-319-08958-4_34",

language = "English",

isbn = "9783319089577",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "419--431",

booktitle = "Human Language Technology Challenges for Computer Science and Linguistics - 5th Language and Technology Conference, LTC 2011, Revised Selected Papers",

note = "5th Language and Technology Conference, LTC 2011 ; Conference date: 25-11-2011 Through 27-11-2011",

}

TY - GEN

T1 - Improving the distribution of N-grams in phrase tables obtained by the sampling-based method

AU - Luo, Juan

AU - Lardilleux, Adrien

AU - Lepage, Yves

PY - 2014/1/1

Y1 - 2014/1/1

N2 - We describe an approach to improve the performance of sampling-based sub-sentential alignment method on translation tasks by investigating the distribution of n-grams in the phrase tables. This approach consists in enforcing the alignment of n-grams. We compare the quality of phrase translation tables output by this approach and that of the state-of-the-art estimation approach in statistical machine translation tasks. We report significant improvements for this approach and show that merging phrase tables outperforms the state-of-the-art techniques.

AB - We describe an approach to improve the performance of sampling-based sub-sentential alignment method on translation tasks by investigating the distribution of n-grams in the phrase tables. This approach consists in enforcing the alignment of n-grams. We compare the quality of phrase translation tables output by this approach and that of the state-of-the-art estimation approach in statistical machine translation tasks. We report significant improvements for this approach and show that merging phrase tables outperforms the state-of-the-art techniques.

KW - Statistical machine translation

KW - Sub-sentential alignment

UR - http://www.scopus.com/inward/record.url?scp=84905855861&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84905855861&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-08958-4_34

DO - 10.1007/978-3-319-08958-4_34

M3 - Conference contribution

AN - SCOPUS:84905855861

SN - 9783319089577

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 419

EP - 431

BT - Human Language Technology Challenges for Computer Science and Linguistics - 5th Language and Technology Conference, LTC 2011, Revised Selected Papers

PB - Springer Verlag

T2 - 5th Language and Technology Conference, LTC 2011

Y2 - 25 November 2011 through 27 November 2011

ER -