MACHINE LEARNING AND REPRODUCIBILITY IMPACT OF RANDOM NUMBERS - Archive ouverte HAL
Pré-Publication, Document De Travail Année : 2024

MACHINE LEARNING AND REPRODUCIBILITY IMPACT OF RANDOM NUMBERS

Résumé

Reproducibility stands as a pivotal pillar of the scientific method, bolstering confidence in research outcomes. When the findings of a study cannot be consistently reproduced, it gives rise to concerns regarding the validity of the drawn conclusions. This paper delves into an exploration of the Deep Embedded Clustering algorithm. After a first observation of nonreproducibility, we tried to reconstruct the algorithm and we faced repeatability issues, not being able to obtain identical results from run-to-run with the same hardware and exactly the same environment. We have then studied a number of avenues, which could lead to such problems. We were finally able to achieve run-to-run repeatability on an identical machine, thanks to a particular insight into stochastic parameters and a proper use of hidden pseudorandom number generators. However, we observed differences from one machine to another, indicating that portability is not guaranteed leading to more investigation. Nevertheless, with repeatability on the same machine, we can initiate a reproducibility study.
Fichier principal
Vignette du fichier
2024 ESM Draft AI ML RRR PRNG Repro.pdf (476.71 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-04642175 , version 1 (09-07-2024)
hal-04642175 , version 2 (10-07-2024)

Licence

Identifiants

  • HAL Id : hal-04642175 , version 1

Citer

David Hill, Benjamin A. Antunes, Anthony Bertrand, Engelbert Mephu Nguifo, Loïc Yon, et al.. MACHINE LEARNING AND REPRODUCIBILITY IMPACT OF RANDOM NUMBERS. 2024. ⟨hal-04642175v1⟩
64 Consultations
54 Téléchargements

Partager

More