Motion detection of articulatory movement with paralinguistic information using real-time MRI movie

Takuya Asai, Hideaki Kikuchi, Kikuo Maekawa

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The goal of this study is to establish the analytical method of articulatory movement by real-time magnetic resonance images (rtMRI) without estimation of articulatory contours. We present the result of motion detection using a background subtraction method. As a result of applying the background subtraction method to the rtMRI data of one speaker, some motions were detected in tongue, lip, and lower jaw which are important places for speech generation. By the experiments with the movies of multiple speakers, we confirmed that it is possible to detect the motion of the basic articulatory movement, and some movements were different for each speaker. Furthermore, we adapted the proposed method for motion detection to the utterances aiming at the transmission of paralinguistic information. As a result, some similar movements to the previous research were observed.

Original languageEnglish
Title of host publication2019 22nd Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques, O-COCOSDA 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728124490
DOIs
Publication statusPublished - 2019 Oct
Event22nd Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques, O-COCOSDA 2019 - Cebu, Philippines
Duration: 2019 Oct 252019 Oct 27

Publication series

Name2019 22nd Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques, O-COCOSDA 2019
Volume2019-January

Conference

Conference22nd Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques, O-COCOSDA 2019
Country/TerritoryPhilippines
CityCebu
Period19/10/2519/10/27

Keywords

  • Motion detection
  • Multimodal
  • Paralinguistic information
  • Real-time MRI
  • Speech production

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Signal Processing
  • Information Systems and Management
  • Linguistics and Language
  • Communication

Fingerprint

Dive into the research topics of 'Motion detection of articulatory movement with paralinguistic information using real-time MRI movie'. Together they form a unique fingerprint.

Cite this