Adjusting occurrence probabilities of automatically-generated abbreviated words in spoken dialogue systems

Masaki Katsumaru, Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Users often abbreviate long words when using spoken dialogue systems, which results in automatic speech recognition (ASR) errors. We define abbreviated words as sub-words of an original word and add them to the ASR dictionary. The first problem we face is that proper nouns cannot be correctly segmented by general morphological analyzers, although long and compound words need to be segmented in agglutinative languages such as Japanese. The second is that, as vocabulary size increases, adding many abbreviated words degrades the ASR accuracy. We have developed two methods, (1) to segment words by using conjunction probabilities between characters, and (2) to adjust occurrence probabilities of generated abbreviated words on the basis of the following two cues: phonological similarities between the abbreviated and original words and frequencies of abbreviated words in Web documents. Our method improves ASR accuracy by 34.9 points for utterances containing abbreviated words without degrading the accuracy for utterances containing original words.

Original languageEnglish
Title of host publicationNext-Generation Applied Intelligence - 22nd International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2009, Proceedings
Pages481-490
Number of pages10
DOIs
Publication statusPublished - 2009 Nov 9
Externally publishedYes
Event22nd International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2009 - Tainan, Taiwan, Province of China
Duration: 2009 Jun 242009 Jun 27

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5579 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference22nd International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2009
CountryTaiwan, Province of China
CityTainan
Period09/6/2409/6/27

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Adjusting occurrence probabilities of automatically-generated abbreviated words in spoken dialogue systems'. Together they form a unique fingerprint.

  • Cite this

    Katsumaru, M., Komatani, K., Ogata, T., & Okuno, H. G. (2009). Adjusting occurrence probabilities of automatically-generated abbreviated words in spoken dialogue systems. In Next-Generation Applied Intelligence - 22nd International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2009, Proceedings (pp. 481-490). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5579 LNAI). https://doi.org/10.1007/978-3-642-02568-6_49