FeReD: Federated Reinforcement Learning in the DBMS - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

FeReD: Federated Reinforcement Learning in the DBMS

Résumé

Federated learning enables clients to enrich their locally trained models via updates performed by a coordination server based on aggregates of local models. There are multiple advances in methods and applications of federated learning, in particular in cross-device federation, where clients having limited data and computational resources collaborate in a joint learning problem. Given the constraint of limited resources in cross-device federation, we study the potential benefits of embedded in-DBMS learning, illustrated in a federated reinforcement learning problem. We demonstrate FeReD, a system that contrasts the performance of cross-device federation using Q-learning, a popular reinforcement learning algorithm. FeReD offers step-by-step guidance for in-DBMS SQLite implementation challenges for both horizontal and vertical data partitioning. FeReD also allows to contrast the Q-learning implementations in SQLite vs a standard Python implementation, by highlighting their learning performance, computational efficiency, succinctness and expressiveness. A video of FeReD is available at https://www.youtube.com/watch?v=2kRIu_C5RZA and its open source code at https://github.com/sotostzam/FeReD.
Fichier non déposé

Dates et versions

hal-03819735 , version 1 (18-10-2022)

Identifiants

Citer

Sotirios Tzamaras, Radu Ciucanu, Marta Soare, Sihem Amer-Yahia. FeReD: Federated Reinforcement Learning in the DBMS. CIKM '22: The 31st ACM International Conference on Information and Knowledge Management, Oct 2022, Atlanta GA, United States. pp.4989-4993, ⟨10.1145/3511808.3557203⟩. ⟨hal-03819735⟩
78 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More