Detecting and adapting to crisis pattern with context based Deep Reinforcement Learning - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2021

Detecting and adapting to crisis pattern with context based Deep Reinforcement Learning

Résumé

Deep reinforcement learning (DRL) has reached super human levels in complex tasks like game solving (Go [1], StarCraft II [2]), and autonomous driving [3]. However, it remains an open question whether DRL can reach human level in applications to financial problems and in particular in detecting pattern crisis and consequently dis-investing. In this paper, we present an innovative DRL framework consisting in two sub-networks fed respectively with portfolio strategies past performances and standard deviations as well as additional contextual features. The second sub network plays an important role as it captures dependencies with common financial indicators features like risk aversion, economic surprise index and correlations between assets that allows taking into account context based information. We compare different network architectures either using layers of convolutions to reduce network's complexity or LSTM block to capture time dependency and whether previous allocations is important in the modeling. We also use adversarial training to make the final model more robust. Results on test set show this approach substantially over-performs traditional portfolio optimization methods like Markovitz and is able to detect and anticipate crisis like the current Covid one.

Dates et versions

hal-03815026 , version 1 (14-10-2022)

Identifiants

Citer

Eric Benhamou, David Saltiel, Jean-Jacques Ohana, Jamal Atif. Detecting and adapting to crisis pattern with context based Deep Reinforcement Learning. ICPR 2020 - 25th International Conference on Pattern Recognition (ICPR), Jan 2021, Milan, France. pp.10050-10057, ⟨10.1109/ICPR48806.2021.9412958⟩. ⟨hal-03815026⟩
37 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More