Segmenting acoustic signal with articulatory movement using recurrent neural network for phoneme acquisition

Hisashi Kanda*, Tetsuya Ogata, Kazunori Komatani, Hiroshi G. Okuno

*この研究の対応する著者

研究成果: Conference contribution

6 被引用数 (Scopus)

抄録

This paper proposes a computational model for phoneme acquisition by infants. Human infants perceive speech sounds not as discrete phoneme sequences but as continuous acoustic signals. One of critical problems in phoneme acquisition is the design for segmenting these continuous speech sounds. The key idea to solve this problem is that articulatory mechanisms such as the vocal tract help human beings to perceive speech sound units corresponding to phonemes. That is, the ability to distinguish phonemes is learned by recognizing unstable points in the dynamics of continuous sound with articulatory movement. We have developed a vocal imitation system embodying the relationship between articulatory movements and sounds produced by the movements. To segment acoustic signal with articulatory movement, we apply the segmenting method to our system by Recurrent Neural Network with Parametric Bias (RNNPB). This method determines the multiple segmentation boundaries in a temporal sequence using the prediction error of the RNNPB model, and the PB values obtained by the method can be encoded as kind of phonemes. Our system was implemented by using a physical vocal tract model, called the Maeda model. Experimental results demonstrated that our system can self-organize the same phonemes in different continuous sounds. This suggests that our model reflects the process of phoneme acquisition.

本文言語English
ホスト出版物のタイトル2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS
ページ1712-1717
ページ数6
DOI
出版ステータスPublished - 2008 12 1
外部発表はい
イベント2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS - Nice, France
継続期間: 2008 9 222008 9 26

出版物シリーズ

名前2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS

Conference

Conference2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS
国/地域France
CityNice
Period08/9/2208/9/26

ASJC Scopus subject areas

  • 人工知能
  • コンピュータ ビジョンおよびパターン認識
  • 制御およびシステム工学
  • 電子工学および電気工学

フィンガープリント

「Segmenting acoustic signal with articulatory movement using recurrent neural network for phoneme acquisition」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル