Weighted majority vote using Shapley values in crowdsourcing - Archive ouverte HAL
Communication Dans Un Congrès Année : 2024

Weighted majority vote using Shapley values in crowdsourcing

Résumé

Crowdsourcing has emerged as a pivotal paradigm for harnessing collective intelligence to solve data annotation tasks. Effective label aggregation, crucial for leveraging the diverse judgments of contributors, remains a fundamental challenge in crowdsourcing systems. This paper introduces a novel label aggregation strategy based on Shapley values, a concept originating from cooperative game theory. By integrating Shapley values as worker weights into the Weighted Majority Vote label aggregation (WMV), our proposed framework aims to address the interpretability of weights assigned to workers. This aggregation reduces the complexity of probabilistic models and the difficulty of the final interpretation of the aggregation from the workers' votes. We show improved accuracy against other WMV-based label aggregation strategies. We demonstrate the efficiency of our strategy on various real datasets to explore multiple crowdsourcing scenarios.
Fichier principal
Vignette du fichier
cap2024.pdf (1.28 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04573727 , version 1 (13-05-2024)

Identifiants

  • HAL Id : hal-04573727 , version 1

Citer

Tanguy Lefort, Benjamin Charlier, Alexis Joly, Joseph Salmon. Weighted majority vote using Shapley values in crowdsourcing. CAp 2024 - Conférence sur l'Apprentissage Automatique, Jul 2024, Lille, France. ⟨hal-04573727⟩
99 Consultations
101 Téléchargements

Partager

More