TY - GEN
T1 - Motion detection of articulatory movement with paralinguistic information using real-time MRI movie
AU - Asai, Takuya
AU - Kikuchi, Hideaki
AU - Maekawa, Kikuo
N1 - Funding Information:
This work was supported by JSPS KAKENHI Grant Number 17H02339.
Publisher Copyright:
© 2019 IEEE.
PY - 2019/10
Y1 - 2019/10
N2 - The goal of this study is to establish the analytical method of articulatory movement by real-time magnetic resonance images (rtMRI) without estimation of articulatory contours. We present the result of motion detection using a background subtraction method. As a result of applying the background subtraction method to the rtMRI data of one speaker, some motions were detected in tongue, lip, and lower jaw which are important places for speech generation. By the experiments with the movies of multiple speakers, we confirmed that it is possible to detect the motion of the basic articulatory movement, and some movements were different for each speaker. Furthermore, we adapted the proposed method for motion detection to the utterances aiming at the transmission of paralinguistic information. As a result, some similar movements to the previous research were observed.
AB - The goal of this study is to establish the analytical method of articulatory movement by real-time magnetic resonance images (rtMRI) without estimation of articulatory contours. We present the result of motion detection using a background subtraction method. As a result of applying the background subtraction method to the rtMRI data of one speaker, some motions were detected in tongue, lip, and lower jaw which are important places for speech generation. By the experiments with the movies of multiple speakers, we confirmed that it is possible to detect the motion of the basic articulatory movement, and some movements were different for each speaker. Furthermore, we adapted the proposed method for motion detection to the utterances aiming at the transmission of paralinguistic information. As a result, some similar movements to the previous research were observed.
KW - Motion detection
KW - Multimodal
KW - Paralinguistic information
KW - Real-time MRI
KW - Speech production
UR - http://www.scopus.com/inward/record.url?scp=85113890300&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85113890300&partnerID=8YFLogxK
U2 - 10.1109/O-COCOSDA46868.2019.9060850
DO - 10.1109/O-COCOSDA46868.2019.9060850
M3 - Conference contribution
AN - SCOPUS:85113890300
T3 - 2019 22nd Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques, O-COCOSDA 2019
BT - 2019 22nd Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques, O-COCOSDA 2019
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 22nd Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques, O-COCOSDA 2019
Y2 - 25 October 2019 through 27 October 2019
ER -