End-to-End Mobile Robot Navigation using a Residual Deep Reinforcement Learning in Dynamic Human Environments

Abdullah Ahmed*, Yasser F.O. Mohammad, Victor Parque, Haitham El-Hussieny, Sabah Ahmed

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Safe navigation through human crowds is key to enabling practical mobility ubiquitously. The Deep Reinforcement Learning (DRL) and the End-to-End (E2E) approaches to goal-oriented robot navigation have the potential to render policies able to tackle localization, path planning, obstacle avoidance, and adaptation to change in unison. In this paper, we report an architecture based on convolutional units and residual blocks being able to enhance adaptability to unseen and dynamic human environments. In particular, our scheme outperformed the state-of-the-art baselines SOADRL and NAVREP by about 13% and 18% on average success rate, respectively, throughout 27 unseen and dynamic navigation instances. Furthermore, our approach avoids the explicit encoding of positions and trajectories of moving humans compared to the standard models. Our results show the potential to render adaptive and generalizable policies for unknown and dynamic human environments.

Original languageEnglish
Title of host publicationMESA 2022 - 18th IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications, Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665455701
DOIs
Publication statusPublished - 2022
Event18th IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications, MESA 2022 - Virtual, Online, Taiwan, Province of China
Duration: 2022 Nov 282022 Nov 30

Publication series

NameMESA 2022 - 18th IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications, Proceedings

Conference

Conference18th IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications, MESA 2022
Country/TerritoryTaiwan, Province of China
CityVirtual, Online
Period22/11/2822/11/30

Keywords

  • Autonomous Navigation
  • Convolutional Neural Networks
  • Deep Reinforcement Learning
  • Dynamic Environments
  • End-to-End Learning
  • Mobile Robots

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Science Applications
  • Electrical and Electronic Engineering
  • Mechanical Engineering
  • Control and Optimization
  • Instrumentation

Fingerprint

Dive into the research topics of 'End-to-End Mobile Robot Navigation using a Residual Deep Reinforcement Learning in Dynamic Human Environments'. Together they form a unique fingerprint.

Cite this