Exploring augmented reality interaction for everyday multipurpose wearable robots

Jaryd Urbani, Mohammed Al-Sada, Tatsuo Nakajima, Thomas Höglund

    研究成果: Conference contribution

    抄録

    Multipurpose wearable robots are an emerging class of devices, which offer intriguing interaction potential. The interoperability of multipurpose wearable robots and other types of wearable devices remains largely uninvestigated. We take the first steps to bridge this gap by presenting a framework for integrating augmented reality (AR) and multipurpose wearable robots. Our framework uses the publisher-subscriber model to expose different robot functionalities as services on a network. These can be invoked by the AR system. This model is advantageous in coping with different robot morphologies and various interaction methods. We implemented a prototype system using our framework by integrating an AR head-mounted display (HMD) and a wrist-worn robot, and demonstrate four experiences utilizing our prototype solution: 1) Robot status display, 2) shape-changing menus, 3) a media player and 4) a robot pose controller. To evaluate our approach, we performed a user study, which gauged user impressions and usability of developed experiences. Results indicate that our approach was well received, though participants highlighted a number of challenges in AR tracking when interacting within some of the experiences. Lastly, we discuss limitations and future research direction for our project.

    元の言語English
    ホスト出版物のタイトルProceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018
    出版者Institute of Electrical and Electronics Engineers Inc.
    ページ209-216
    ページ数8
    ISBN(電子版)9781538677599
    DOI
    出版物ステータスPublished - 2019 1 9
    イベント24th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018 - Hakodate, Japan
    継続期間: 2018 8 292018 8 31

    出版物シリーズ

    名前Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018

    Conference

    Conference24th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018
    Japan
    Hakodate
    期間18/8/2918/8/31

    Fingerprint

    Augmented reality
    Robots
    Display devices
    Interoperability
    Controllers

    ASJC Scopus subject areas

    • Artificial Intelligence
    • Computer Networks and Communications
    • Computer Science Applications

    これを引用

    Urbani, J., Al-Sada, M., Nakajima, T., & Höglund, T. (2019). Exploring augmented reality interaction for everyday multipurpose wearable robots. : Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018 (pp. 209-216). [8607251] (Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/RTCSA.2018.00033

    Exploring augmented reality interaction for everyday multipurpose wearable robots. / Urbani, Jaryd; Al-Sada, Mohammed; Nakajima, Tatsuo; Höglund, Thomas.

    Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018. Institute of Electrical and Electronics Engineers Inc., 2019. p. 209-216 8607251 (Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018).

    研究成果: Conference contribution

    Urbani, J, Al-Sada, M, Nakajima, T & Höglund, T 2019, Exploring augmented reality interaction for everyday multipurpose wearable robots. : Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018., 8607251, Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018, Institute of Electrical and Electronics Engineers Inc., pp. 209-216, 24th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018, Hakodate, Japan, 18/8/29. https://doi.org/10.1109/RTCSA.2018.00033
    Urbani J, Al-Sada M, Nakajima T, Höglund T. Exploring augmented reality interaction for everyday multipurpose wearable robots. : Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018. Institute of Electrical and Electronics Engineers Inc. 2019. p. 209-216. 8607251. (Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018). https://doi.org/10.1109/RTCSA.2018.00033
    Urbani, Jaryd ; Al-Sada, Mohammed ; Nakajima, Tatsuo ; Höglund, Thomas. / Exploring augmented reality interaction for everyday multipurpose wearable robots. Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 209-216 (Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018).
    @inproceedings{ba9dad47bf2d448da30aaaa521278831,
    title = "Exploring augmented reality interaction for everyday multipurpose wearable robots",
    abstract = "Multipurpose wearable robots are an emerging class of devices, which offer intriguing interaction potential. The interoperability of multipurpose wearable robots and other types of wearable devices remains largely uninvestigated. We take the first steps to bridge this gap by presenting a framework for integrating augmented reality (AR) and multipurpose wearable robots. Our framework uses the publisher-subscriber model to expose different robot functionalities as services on a network. These can be invoked by the AR system. This model is advantageous in coping with different robot morphologies and various interaction methods. We implemented a prototype system using our framework by integrating an AR head-mounted display (HMD) and a wrist-worn robot, and demonstrate four experiences utilizing our prototype solution: 1) Robot status display, 2) shape-changing menus, 3) a media player and 4) a robot pose controller. To evaluate our approach, we performed a user study, which gauged user impressions and usability of developed experiences. Results indicate that our approach was well received, though participants highlighted a number of challenges in AR tracking when interacting within some of the experiences. Lastly, we discuss limitations and future research direction for our project.",
    keywords = "Augmented reality, Human-computer interaction, Wearable robotics",
    author = "Jaryd Urbani and Mohammed Al-Sada and Tatsuo Nakajima and Thomas H{\"o}glund",
    year = "2019",
    month = "1",
    day = "9",
    doi = "10.1109/RTCSA.2018.00033",
    language = "English",
    series = "Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018",
    publisher = "Institute of Electrical and Electronics Engineers Inc.",
    pages = "209--216",
    booktitle = "Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018",

    }

    TY - GEN

    T1 - Exploring augmented reality interaction for everyday multipurpose wearable robots

    AU - Urbani, Jaryd

    AU - Al-Sada, Mohammed

    AU - Nakajima, Tatsuo

    AU - Höglund, Thomas

    PY - 2019/1/9

    Y1 - 2019/1/9

    N2 - Multipurpose wearable robots are an emerging class of devices, which offer intriguing interaction potential. The interoperability of multipurpose wearable robots and other types of wearable devices remains largely uninvestigated. We take the first steps to bridge this gap by presenting a framework for integrating augmented reality (AR) and multipurpose wearable robots. Our framework uses the publisher-subscriber model to expose different robot functionalities as services on a network. These can be invoked by the AR system. This model is advantageous in coping with different robot morphologies and various interaction methods. We implemented a prototype system using our framework by integrating an AR head-mounted display (HMD) and a wrist-worn robot, and demonstrate four experiences utilizing our prototype solution: 1) Robot status display, 2) shape-changing menus, 3) a media player and 4) a robot pose controller. To evaluate our approach, we performed a user study, which gauged user impressions and usability of developed experiences. Results indicate that our approach was well received, though participants highlighted a number of challenges in AR tracking when interacting within some of the experiences. Lastly, we discuss limitations and future research direction for our project.

    AB - Multipurpose wearable robots are an emerging class of devices, which offer intriguing interaction potential. The interoperability of multipurpose wearable robots and other types of wearable devices remains largely uninvestigated. We take the first steps to bridge this gap by presenting a framework for integrating augmented reality (AR) and multipurpose wearable robots. Our framework uses the publisher-subscriber model to expose different robot functionalities as services on a network. These can be invoked by the AR system. This model is advantageous in coping with different robot morphologies and various interaction methods. We implemented a prototype system using our framework by integrating an AR head-mounted display (HMD) and a wrist-worn robot, and demonstrate four experiences utilizing our prototype solution: 1) Robot status display, 2) shape-changing menus, 3) a media player and 4) a robot pose controller. To evaluate our approach, we performed a user study, which gauged user impressions and usability of developed experiences. Results indicate that our approach was well received, though participants highlighted a number of challenges in AR tracking when interacting within some of the experiences. Lastly, we discuss limitations and future research direction for our project.

    KW - Augmented reality

    KW - Human-computer interaction

    KW - Wearable robotics

    UR - http://www.scopus.com/inward/record.url?scp=85061793481&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85061793481&partnerID=8YFLogxK

    U2 - 10.1109/RTCSA.2018.00033

    DO - 10.1109/RTCSA.2018.00033

    M3 - Conference contribution

    AN - SCOPUS:85061793481

    T3 - Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018

    SP - 209

    EP - 216

    BT - Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018

    PB - Institute of Electrical and Electronics Engineers Inc.

    ER -