Predictive models of hard drive failures based on operational data - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2017

Predictive models of hard drive failures based on operational data

Résumé

Hard drives are an essential component of modern data storage. In order to reduce the risk of data loss, hard drive failure prediction methods using the Self-Monitoring, Analysis and Reporting Technology attributes have been proposed. However, these methods were developed from datasets not necessarily representative of operational systems. In this paper, we consider the Backblaze public dataset, a recent operational dataset from over 47,000 drives, exhibiting hard drive heterogeneity with 81 models from 5 manufacturers, an extremely unbalanced ratio of 5000:1 between healthy and failure samples and a real-world loosely controlled environment. We observe that existing predictive models no longer perform sufficiently well on this dataset. We therefore selected machine learning classification methods able to deal with a very unbalanced training set, namely SVM, RF and GBT, and adapted them to the specific constraints of hard drive failure prediction. Our results reach over 95% precision and 67% recall on a one year real-world public dataset of over 12 million records with only 2586 failures
Fichier principal
Vignette du fichier
article_preprint.pdf (598.35 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01703140 , version 1 (22-02-2018)

Identifiants

Citer

Nicolas Aussel, Samuel Jaulin, Guillaume Gandon, Yohan Petetin, Eriza Fazli, et al.. Predictive models of hard drive failures based on operational data. ICMLA 2017 : 16th IEEE International Conference On Machine Learning And Applications, Dec 2017, Cancun, Mexico. pp.619 - 625, ⟨10.1109/ICMLA.2017.00-92⟩. ⟨hal-01703140⟩
362 Consultations
2486 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More