Deep Reinforcement Learning with Omnidirectional Images: application to UAV Navigation in Forests - Imagerie et Vision Artificielle Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

Deep Reinforcement Learning with Omnidirectional Images: application to UAV Navigation in Forests

Résumé

Deep Reinforcement Learning (DRL) is highly efficient for solving complex tasks such as drone obstacle avoidance using cameras. However, these methods are often limited by the camera perception capabilities. In this paper, we demonstrate that point-goal navigation performances can be improved by using cameras with a wider Field-Of-View (FOV). To this end, we present a DRL solution based on equirectangular images and demonstrates its relevance, especially compared to its perspective version. Several visual modalities are compared: ground truth depth, RGB, and depth directly estimated from these 360°R GB images using Deep Learning methods. Next, we propose a spherical adaptation to take into account the spherical distortions of omnidirectional images in the convolutional neural networks (CNNs) used in the actor-critic network and show a significant improvement in navigation performance. Finally, we modify the perspective depth estimation network using this spherical adaptation and demonstrate a further performance improvement.
Fichier principal
Vignette du fichier
ICARCV_OMNI_22.pdf (1.14 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03812448 , version 1 (12-10-2022)

Identifiants

  • HAL Id : hal-03812448 , version 1

Citer

Charles-Olivier Artizzu, Guillaume Allibert, Cédric Demonceaux. Deep Reinforcement Learning with Omnidirectional Images: application to UAV Navigation in Forests. 17th International Conference on Control, Automation, Robotics and Vision (Finalist "Best Paper Student"), Dec 2022, Singapore, Singapore. ⟨hal-03812448⟩
67 Consultations
150 Téléchargements

Partager

Gmail Facebook X LinkedIn More