Spacecraft Autonomous Decision-Planning for Collision Avoidance : a Reinforcement Learning Approach - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Spacecraft Autonomous Decision-Planning for Collision Avoidance : a Reinforcement Learning Approach

Nicolas Bourriez
  • Fonction : Auteur
  • PersonId : 1322187
Adrien Loizeau
  • Fonction : Auteur
  • PersonId : 1322188
Adam Abdin
Connectez-vous pour contacter l'auteur

Résumé

The space environment around the Earth is becoming increasingly populated by both active spacecraft and space debris. To avoid potential collision events, significant improvements in Space Situational Awareness (SSA) activities and Collision Avoidance (CA) technologies are allowing the tracking and maneuvering of spacecraft with increasing accuracy and reliability. However, these procedures still largely involve a high level of human intervention to make the necessary decisions. For an increasingly complex space environment, this decision-making strategy is not likely to be sustainable. Therefore, it is important to successfully introduce higher levels of automation for key Space Traffic Management (STM) processes to ensure the level of reliability needed for navigating a large number of spacecraft. These processes range from collision risk detection to the identification of the appropriate action to take and the execution of avoidance maneuvers. This work proposes an implementation of autonomous CA decision-making capabilities on spacecraft based on Reinforcement Learning (RL) techniques. A novel methodology based on a Partially Observable Markov Decision Process (POMDP) framework is developed to train the Artificial Intelligence (AI) system on board the spacecraft, considering epistemic and aleatory uncertainties. The proposed framework considers imperfect monitoring information about the status of the debris in orbit and allows the AI system to effectively learn stochastic policies to perform accurate Collision Avoidance Maneuvers (CAMs). The objective is to successfully delegate the decision-making process for autonomously implementing a CAM to the spacecraft without human intervention. This approach would allow for a faster response in the decision-making process and for highly decentralized operations.
Fichier principal
Vignette du fichier
Spacecraft Decision Planning.pdf (1.74 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04334473 , version 1 (11-12-2023)

Identifiants

  • HAL Id : hal-04334473 , version 1

Citer

Nicolas Bourriez, Adrien Loizeau, Adam Abdin. Spacecraft Autonomous Decision-Planning for Collision Avoidance : a Reinforcement Learning Approach. 74th International Astronautical Congress (IAC), International Astronautical Federation (IAF), Oct 2023, Baku, Azerbaijan. ⟨hal-04334473⟩

Collections

CENTRALESUPELEC
5 Consultations
16 Téléchargements

Partager

Gmail Facebook X LinkedIn More