Parallel Distributional Deep Reinforcement Learning for Mapless Navigation of Terrestrial Mobile Robots

Kich, Victor Augusto, Kolling, Alisson Henrique, de Jesus, Junior Costa, Heisler, Gabriel V., Jacobs, Hiago, Bottega, Jair Augusto, Kelbouscas, André L. da S., Ohya, Akihisa, Grando, Ricardo Bedin, Drews-Jr, Paulo Lilles Jorge, Gamarra, Daniel Fernando Tello

arXiv.org Artificial Intelligence 

This paper introduces novel deep reinforcement learning (Deep-RL) techniques using parallel distributional actor-critic networks for navigating terrestrial mobile robots. Our approaches use laser range findings, relative distance, and angle to the target to guide the robot. We trained agents in the Gazebo simulator and deployed them in real scenarios. Results show that parallel distributional Deep-RL algorithms enhance decision-making and outperform non-distributional and behavior-based approaches in navigation and spatial generalization.