Exploring augmented reality interaction for everyday multipurpose wearable robots

Jaryd Urbani, Mohammed Al-Sada, Tatsuo Nakajima, Thomas Höglund

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    Multipurpose wearable robots are an emerging class of devices, which offer intriguing interaction potential. The interoperability of multipurpose wearable robots and other types of wearable devices remains largely uninvestigated. We take the first steps to bridge this gap by presenting a framework for integrating augmented reality (AR) and multipurpose wearable robots. Our framework uses the publisher-subscriber model to expose different robot functionalities as services on a network. These can be invoked by the AR system. This model is advantageous in coping with different robot morphologies and various interaction methods. We implemented a prototype system using our framework by integrating an AR head-mounted display (HMD) and a wrist-worn robot, and demonstrate four experiences utilizing our prototype solution: 1) Robot status display, 2) shape-changing menus, 3) a media player and 4) a robot pose controller. To evaluate our approach, we performed a user study, which gauged user impressions and usability of developed experiences. Results indicate that our approach was well received, though participants highlighted a number of challenges in AR tracking when interacting within some of the experiences. Lastly, we discuss limitations and future research direction for our project.

    Original languageEnglish
    Title of host publicationProceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Pages209-216
    Number of pages8
    ISBN (Electronic)9781538677599
    DOIs
    Publication statusPublished - 2019 Jan 9
    Event24th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018 - Hakodate, Japan
    Duration: 2018 Aug 292018 Aug 31

    Publication series

    NameProceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018

    Conference

    Conference24th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018
    CountryJapan
    CityHakodate
    Period18/8/2918/8/31

      Fingerprint

    Keywords

    • Augmented reality
    • Human-computer interaction
    • Wearable robotics

    ASJC Scopus subject areas

    • Artificial Intelligence
    • Computer Networks and Communications
    • Computer Science Applications

    Cite this

    Urbani, J., Al-Sada, M., Nakajima, T., & Höglund, T. (2019). Exploring augmented reality interaction for everyday multipurpose wearable robots. In Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018 (pp. 209-216). [8607251] (Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/RTCSA.2018.00033