Exploiting shared Chinese characters in Chinese word segmentation optimization for Chinese-Japanese Machine Translation

Chenhui Chu, Toshiaki Nakazawa, Daisuke Kawahara, Sadao Kurohashi

Research output: Contribution to conferencePaper

11 Citations (Scopus)

Abstract

Unknown words and word segmentation granularity are two main problems in Chinese word segmentation for Chinese-Japanese Machine Translation (MT). In this paper, we propose an approach of exploiting common Chinese characters shared between Chinese and Japanese in Chinese word segmentation optimization for MT aiming to solve these problems. We augment the system dictionary of a Chinese segmenter by extracting Chinese lexicons from a parallel training corpus. In addition, we adjust the granularity of the training data for the Chinese segmenter to that of Japanese. Experimental results of Chinese-Japanese MT on a phrase-based SMT system show that our approach improves MT performance significantly.

Original languageEnglish
Pages35-42
Number of pages8
Publication statusPublished - 2012
Externally publishedYes
Event16th Annual Conference of the European Association for Machine Translation, EAMT 2012 - Trento, Italy
Duration: 2012 May 282012 May 30

Other

Other16th Annual Conference of the European Association for Machine Translation, EAMT 2012
CountryItaly
CityTrento
Period12/5/2812/5/30

ASJC Scopus subject areas

  • Language and Linguistics
  • Human-Computer Interaction
  • Software

Fingerprint Dive into the research topics of 'Exploiting shared Chinese characters in Chinese word segmentation optimization for Chinese-Japanese Machine Translation'. Together they form a unique fingerprint.

  • Cite this

    Chu, C., Nakazawa, T., Kawahara, D., & Kurohashi, S. (2012). Exploiting shared Chinese characters in Chinese word segmentation optimization for Chinese-Japanese Machine Translation. 35-42. Paper presented at 16th Annual Conference of the European Association for Machine Translation, EAMT 2012, Trento, Italy.