How to judge a competition: Fairly judging a competition or assessing benchmark results
Résumé
This paper addresses how to minimize randomness in competition or benchmark judging. We discuss scoring metrics, size of test data, error bars, splitting into phases, and score aggregation methods. Our approach blends theoretical insights with practical guidelines, aiming to provide a clear framework for effective decision making and reduced uncertainty.
Domaines
Fichier principal
judging_competition_book_chapter4_adrien_pavao-1.pdf (1.04 Mo)
Télécharger le fichier
| Origine | Fichiers produits par l'(les) auteur(s) |
|---|---|
| Licence |