Efficient Worker Selection Through History-based Learning in Crowdsourcing - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2017

Efficient Worker Selection Through History-based Learning in Crowdsourcing

Résumé

Crowdsourcing has emerged as a promising approach for obtaining services and data in a short time and at a reasonable budget. However, the quality of the output provided by the crowd is not guaranteed, and must be controlled. This quality control usually relies on worker screening or contribution reviewing at the cost of additional time and budget overheads. In this paper, we propose to reduce these overheads by leveraging the system history. We describe an offline learning algorithm that groups tasks from history into homogeneous clusters and learns for each cluster the worker features that optimize the contribution quality. These features are then used by the online targeting algorithm to select reliable workers for each incoming task. The proposed method is compared to the state of the art selection methods using real world datasets. Results show that we achieve comparable, and in some cases better, output quality for a smaller budget and shorter time.
Fichier principal
Vignette du fichier
Awwad2017.pdf (205.02 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-01567896 , version 1 (12-05-2022)

Licence

Paternité - Pas d'utilisation commerciale

Identifiants

Citer

Tarek Awwad, Nadia Bennani, Konstantin Ziegler, Veronika Rehn Sonigo, Lionel Brunie, et al.. Efficient Worker Selection Through History-based Learning in Crowdsourcing. Computer Software and Applications Conference COMPSAC, IEEE, Jul 2017, Turin, Italy. pp.923-928, ⟨10.1109/COMPSAC.2017.275⟩. ⟨hal-01567896⟩
539 Consultations
69 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More