Pré-Publication, Document De Travail Année : 2025

Differentially Private Policy Gradient

Résumé

Motivated by the increasing deployment of reinforcement learning in the real world, involving a large consumption of personal data, we introduce a differentially private (DP) policy gradient algorithm. We show that, in this setting, the introduction of Differential Privacy can be reduced to the computation of appropriate trust regions, thus avoiding the sacrifice of theoretical properties of the DP-less methods. Therefore, we show that it is possible to find the right trade-off between privacy noise and trust-region size to obtain a performant differentially private policy gradient algorithm. We then outline its performance empirically on various benchmarks. Our results and the complexity of the tasks addressed represent a significant improvement over existing DP algorithms in online RL.

Fichier principal
Vignette du fichier
main.pdf (820.53 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-05051902 , version 1 (30-04-2025)

Licence

Identifiants

  • HAL Id : hal-05051902 , version 1

Citer

Alexandre Rio, Merwan Barlier, Igor Colin. Differentially Private Policy Gradient. 2025. ⟨hal-05051902⟩
846 Consultations
116 Téléchargements

Partager

  • More