Secure Protocols for Best Arm Identification in Federated Stochastic Multi-Armed Bandits - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Dependable and Secure Computing Année : 2023

Secure Protocols for Best Arm Identification in Federated Stochastic Multi-Armed Bandits

Résumé

The stochastic multi-armed bandit is a classical reinforcement learning model, where a learning agent sequentially chooses an action (pull a bandit arm) and the environment responds with a stochastic reward drawn from an unknown distribution associated with the chosen action. A popular objective for the agent is to identify the arm having the maximum expected reward, also known as the best arm identification problem. We address the security concerns that occur in a cross-silo federated learning setting, where multiple data owners collaborate under the orchestration of a server to execute a best arm identification algorithm. We propose three secure protocols, which guarantee desirable security properties for the: input data (i.e., reward values), intermediate data (i.e., sums of rewards), and output data (i.e., ranking of arms and in particular the identified best arm). Each protocol has a different architecture, uses different techniques, and proposes a different trade-off with respect to several criteria that we thoroughly analyze: number of participants, generality of the supported reward functions, cryptographic overhead, and communication cost. To build our protocols, we rely on secure multi-party computation, AES-CBC, and the additive homomorphic property of Paillier.
Fichier non déposé

Dates et versions

hal-03595189 , version 1 (03-03-2022)

Licence

Paternité

Identifiants

Citer

Radu Ciucanu, Anatole Delabrouille, Pascal Lafourcade, Marta Soare. Secure Protocols for Best Arm Identification in Federated Stochastic Multi-Armed Bandits. IEEE Transactions on Dependable and Secure Computing, 2023, 20 (2), ⟨10.1109/TDSC.2022.3154585⟩. ⟨hal-03595189⟩
90 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More