Exploring augmented reality interaction for everyday multipurpose wearable robots

Jaryd Urbani, Mohammed Al-Sada, Tatsuo Nakajima, Thomas Höglund

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    Multipurpose wearable robots are an emerging class of devices, which offer intriguing interaction potential. The interoperability of multipurpose wearable robots and other types of wearable devices remains largely uninvestigated. We take the first steps to bridge this gap by presenting a framework for integrating augmented reality (AR) and multipurpose wearable robots. Our framework uses the publisher-subscriber model to expose different robot functionalities as services on a network. These can be invoked by the AR system. This model is advantageous in coping with different robot morphologies and various interaction methods. We implemented a prototype system using our framework by integrating an AR head-mounted display (HMD) and a wrist-worn robot, and demonstrate four experiences utilizing our prototype solution: 1) Robot status display, 2) shape-changing menus, 3) a media player and 4) a robot pose controller. To evaluate our approach, we performed a user study, which gauged user impressions and usability of developed experiences. Results indicate that our approach was well received, though participants highlighted a number of challenges in AR tracking when interacting within some of the experiences. Lastly, we discuss limitations and future research direction for our project.

    Original languageEnglish
    Title of host publicationProceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Pages209-216
    Number of pages8
    ISBN (Electronic)9781538677599
    DOIs
    Publication statusPublished - 2019 Jan 9
    Event24th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018 - Hakodate, Japan
    Duration: 2018 Aug 292018 Aug 31

    Publication series

    NameProceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018

    Conference

    Conference24th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018
    CountryJapan
    CityHakodate
    Period18/8/2918/8/31

    Fingerprint

    Augmented reality
    Robots
    Display devices
    Interoperability
    Controllers

    Keywords

    • Augmented reality
    • Human-computer interaction
    • Wearable robotics

    ASJC Scopus subject areas

    • Artificial Intelligence
    • Computer Networks and Communications
    • Computer Science Applications

    Cite this

    Urbani, J., Al-Sada, M., Nakajima, T., & Höglund, T. (2019). Exploring augmented reality interaction for everyday multipurpose wearable robots. In Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018 (pp. 209-216). [8607251] (Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/RTCSA.2018.00033

    Exploring augmented reality interaction for everyday multipurpose wearable robots. / Urbani, Jaryd; Al-Sada, Mohammed; Nakajima, Tatsuo; Höglund, Thomas.

    Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018. Institute of Electrical and Electronics Engineers Inc., 2019. p. 209-216 8607251 (Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018).

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Urbani, J, Al-Sada, M, Nakajima, T & Höglund, T 2019, Exploring augmented reality interaction for everyday multipurpose wearable robots. in Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018., 8607251, Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018, Institute of Electrical and Electronics Engineers Inc., pp. 209-216, 24th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018, Hakodate, Japan, 18/8/29. https://doi.org/10.1109/RTCSA.2018.00033
    Urbani J, Al-Sada M, Nakajima T, Höglund T. Exploring augmented reality interaction for everyday multipurpose wearable robots. In Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018. Institute of Electrical and Electronics Engineers Inc. 2019. p. 209-216. 8607251. (Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018). https://doi.org/10.1109/RTCSA.2018.00033
    Urbani, Jaryd ; Al-Sada, Mohammed ; Nakajima, Tatsuo ; Höglund, Thomas. / Exploring augmented reality interaction for everyday multipurpose wearable robots. Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 209-216 (Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018).
    @inproceedings{ba9dad47bf2d448da30aaaa521278831,
    title = "Exploring augmented reality interaction for everyday multipurpose wearable robots",
    abstract = "Multipurpose wearable robots are an emerging class of devices, which offer intriguing interaction potential. The interoperability of multipurpose wearable robots and other types of wearable devices remains largely uninvestigated. We take the first steps to bridge this gap by presenting a framework for integrating augmented reality (AR) and multipurpose wearable robots. Our framework uses the publisher-subscriber model to expose different robot functionalities as services on a network. These can be invoked by the AR system. This model is advantageous in coping with different robot morphologies and various interaction methods. We implemented a prototype system using our framework by integrating an AR head-mounted display (HMD) and a wrist-worn robot, and demonstrate four experiences utilizing our prototype solution: 1) Robot status display, 2) shape-changing menus, 3) a media player and 4) a robot pose controller. To evaluate our approach, we performed a user study, which gauged user impressions and usability of developed experiences. Results indicate that our approach was well received, though participants highlighted a number of challenges in AR tracking when interacting within some of the experiences. Lastly, we discuss limitations and future research direction for our project.",
    keywords = "Augmented reality, Human-computer interaction, Wearable robotics",
    author = "Jaryd Urbani and Mohammed Al-Sada and Tatsuo Nakajima and Thomas H{\"o}glund",
    year = "2019",
    month = "1",
    day = "9",
    doi = "10.1109/RTCSA.2018.00033",
    language = "English",
    series = "Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018",
    publisher = "Institute of Electrical and Electronics Engineers Inc.",
    pages = "209--216",
    booktitle = "Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018",

    }

    TY - GEN

    T1 - Exploring augmented reality interaction for everyday multipurpose wearable robots

    AU - Urbani, Jaryd

    AU - Al-Sada, Mohammed

    AU - Nakajima, Tatsuo

    AU - Höglund, Thomas

    PY - 2019/1/9

    Y1 - 2019/1/9

    N2 - Multipurpose wearable robots are an emerging class of devices, which offer intriguing interaction potential. The interoperability of multipurpose wearable robots and other types of wearable devices remains largely uninvestigated. We take the first steps to bridge this gap by presenting a framework for integrating augmented reality (AR) and multipurpose wearable robots. Our framework uses the publisher-subscriber model to expose different robot functionalities as services on a network. These can be invoked by the AR system. This model is advantageous in coping with different robot morphologies and various interaction methods. We implemented a prototype system using our framework by integrating an AR head-mounted display (HMD) and a wrist-worn robot, and demonstrate four experiences utilizing our prototype solution: 1) Robot status display, 2) shape-changing menus, 3) a media player and 4) a robot pose controller. To evaluate our approach, we performed a user study, which gauged user impressions and usability of developed experiences. Results indicate that our approach was well received, though participants highlighted a number of challenges in AR tracking when interacting within some of the experiences. Lastly, we discuss limitations and future research direction for our project.

    AB - Multipurpose wearable robots are an emerging class of devices, which offer intriguing interaction potential. The interoperability of multipurpose wearable robots and other types of wearable devices remains largely uninvestigated. We take the first steps to bridge this gap by presenting a framework for integrating augmented reality (AR) and multipurpose wearable robots. Our framework uses the publisher-subscriber model to expose different robot functionalities as services on a network. These can be invoked by the AR system. This model is advantageous in coping with different robot morphologies and various interaction methods. We implemented a prototype system using our framework by integrating an AR head-mounted display (HMD) and a wrist-worn robot, and demonstrate four experiences utilizing our prototype solution: 1) Robot status display, 2) shape-changing menus, 3) a media player and 4) a robot pose controller. To evaluate our approach, we performed a user study, which gauged user impressions and usability of developed experiences. Results indicate that our approach was well received, though participants highlighted a number of challenges in AR tracking when interacting within some of the experiences. Lastly, we discuss limitations and future research direction for our project.

    KW - Augmented reality

    KW - Human-computer interaction

    KW - Wearable robotics

    UR - http://www.scopus.com/inward/record.url?scp=85061793481&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85061793481&partnerID=8YFLogxK

    U2 - 10.1109/RTCSA.2018.00033

    DO - 10.1109/RTCSA.2018.00033

    M3 - Conference contribution

    AN - SCOPUS:85061793481

    T3 - Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018

    SP - 209

    EP - 216

    BT - Proceedings - 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications, RTCSA 2018

    PB - Institute of Electrical and Electronics Engineers Inc.

    ER -