Distributed File System based on Erasure Coding for I/O Intensive Applications - Archive ouverte HAL
Communication Dans Un Congrès Année : 2014

Distributed File System based on Erasure Coding for I/O Intensive Applications

Résumé

Distributed storage systems take advantage of the network, storage and computational resources to provide a scalable infrastructure. But in such large system, failures are frequent and expected. Data replication is the common technique to provide fault-tolerance but suffers from its important storage consumption. Erasure coding is an alternative that offers the same data protection but reduces significantly the storage consumption. As it entails additional workload, current storage providers limit its use for longterm storage. We present the Mojette Transform (MT), an erasure code whose computations rely on fast XOR operations. The MT is part of RozoFS, a distributed file system that provides a global namespace relying on a cluster of storage nodes. This work is part of our ongoing effort to prove that erasure coding is not necessarily a bottleneck for intense I/O applications. In order to validate our approach, we consider a case study involving a storage cluster of RozoFS that supports video editing as an I/O intensive application.
Fichier principal
Vignette du fichier
closer.pdf (258.67 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01149847 , version 1 (13-03-2018)

Identifiants

Citer

Dimitri Pertin, Sylvain David, Pierre Evenou, Benoît Parrein, Nicolas Normand. Distributed File System based on Erasure Coding for I/O Intensive Applications. 4th International Conference on Cloud Computing and Service Science (CLOSER), INSTICC, Apr 2014, Barcelone, Spain. pp.451-456, ⟨10.5220/0004960604510456⟩. ⟨hal-01149847⟩
318 Consultations
998 Téléchargements

Altmetric

Partager

More