Understanding natural language sentences with word embedding and multi-modal interaction

Junpei Zhong, Tetsuya Ogata, Angelo Cangelosi, Chenguang Yang

    研究成果: Conference contribution

    4 被引用数 (Scopus)

    抄録

    Understanding and grounding human commands with natural languages have been a fundamental requirement for service robotic applications. Although there have been several attempts toward this goal, the bottleneck still exists to store and process the corpora of natural language in an interaction system. Currently, the neural- and statistical-based (N&S) natural language processing have shown potential to solve this problem. With the availability of large data-sets nowadays, these processing methods are able to extract semantic relationships while parsing a corpus of natural language (NL) text without much human design, compared with the rule-based language processing methods. In this paper, we show that how two N&S based word embedding methods, called Word2vec and GloVe, can be used in natural language understanding as pre-training tools in a multi-modal environment. Together with two different multiple time-scale recurrent neural models, they form hybrid neural language understanding models for a robot manipulation experiment.

    本文言語English
    ホスト出版物のタイトル7th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics, ICDL-EpiRob 2017
    出版社Institute of Electrical and Electronics Engineers Inc.
    ページ184-189
    ページ数6
    2018-January
    ISBN(電子版)9781538637159
    DOI
    出版ステータスPublished - 2018 4 2
    イベント7th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics, ICDL-EpiRob 2017 - Lisbon, Portugal
    継続期間: 2017 9 182017 9 21

    Other

    Other7th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics, ICDL-EpiRob 2017
    CountryPortugal
    CityLisbon
    Period17/9/1817/9/21

    ASJC Scopus subject areas

    • Artificial Intelligence
    • Mechanical Engineering
    • Control and Optimization
    • Developmental Neuroscience

    フィンガープリント 「Understanding natural language sentences with word embedding and multi-modal interaction」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

    引用スタイル