Degradation tolerant control learning for discrete-time affine nonlinear systems - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Degradation tolerant control learning for discrete-time affine nonlinear systems

Résumé

This paper develops a degradation tolerant optimal control in the framework of Reinforcement Learning (RL). Safety-critical and mission-critical systems require the development of new control designs that maintain system stability and performance specifications but also address incipient degradation. The aim of this work is to decelerate the speed of degradation by minimizing a cost function that includes the rate of evolution of degradation and the performance requirements. The controller is developed for discrete-time nonlinear systems affine in control, where the system's states are affected by a nonlinear degradation. Value iteration (VI) algorithm based approach is developed to find suitable approximations of both optimal control policy and optimal cost, while guaranteeing closed-loop stability and minimization of degradation rate. Offline model-based Adaptive Dynamic Programming (ADP) algorithm is developed and implemented using actor-critic structure which involves training of both actor and critic neural networks (NN). After training the actor NN with the optimal policy, the NN is implemented in real time to generate the input of the system. Simulation example shows the efficiency and feasibility of the algorithm.
Fichier principal
Vignette du fichier
IFAC_WorldCongress_Soha_Final(10).pdf (565.65 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04307032 , version 1 (25-11-2023)

Identifiants

Citer

Soha Kanso, Mayank Shekhar Jha, Didier Theilliol. Degradation tolerant control learning for discrete-time affine nonlinear systems. 22nd IFAC World Congress, IFAC 2023, Jul 2023, Yokohama, Japan. ⟨10.1016/j.ifacol.2023.10.1178⟩. ⟨hal-04307032⟩
8 Consultations
8 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More