Deep reinforcement learning approach for UAV search path planning in discrete time and space - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2024

Deep reinforcement learning approach for UAV search path planning in discrete time and space

Résumé

Path planning for search missions carried out by Unmanned Aerial Vehicles (UAVs) is a challenging problem. This is due to UAV limited energy budget and the importance of time for search operations. The objective of this study is to come up with an approach to minimize the total search time required to locate a specific target. To achieve this, we deployed a deep reinforcement learning (DRL) model based on the Proximal Policy Optimization (PPO) algorithm to solve the combinatorial optimization problem of UAV search path planning within a minimized search time. A smart reward formulation is designed to achieve the learning goal, fulfill the search requirement, and encourage the agent to select search paths that minimize search time. In addition, we employed Optuna hyperparameter optimization framework to systematically select optimal parameters for the PPO model. Most importantly, thanks to the state representation we considered, the model is generalized and adaptable to various search environments. The PPO model succeeds to compute an accurate search path to be followed by the UAV searcher. Results of the model are compared with results previously obtained with a linear program. We found that the PPO achieves almost the same expected search time, which proves the great relevance of the reward design and the hyperparameters selection we made.
Fichier principal
Vignette du fichier
1571001749 final.pdf (543.53 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04836227 , version 1 (13-12-2024)

Licence

Identifiants

Citer

Najoua Benalaya, Ichrak Amdouni, Cédric Adjih, Anis Laouiti, Leila Azouz Saidane. Deep reinforcement learning approach for UAV search path planning in discrete time and space. The 20th International Wireless Communications and Mobile Computing (IWCMC), May 2024, Ayia Napa, Cyprus. pp.1437-1442, ⟨10.1109/IWCMC61514.2024.10592510⟩. ⟨hal-04836227⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

More