Block placement in distributed file systems based on block access frequency - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Access Année : 2018

Block placement in distributed file systems based on block access frequency

Résumé

This paper proposes a new data placement policy to allocate data blocks across storage servers of distribute/parallel file systems, for yielding even block access workload distribution. To this end, we first analyze the history of block access sequence of a specific application, and then introduce a k-partition algorithm to divide data blocks into multiple groups, by referring their access frequency. After that, each group has almost same access workloads, we can thus distribute these block groups onto storage servers of distributed file system, to achieve the goal of uniformly assigning data blocks when running the application. In summary, this newly proposed data placement policy can yield not only an even data distribution, but also the block data access balance. The experimental results show that the proposed scheme can greatly reduce I/O time and better improve utilization of storage servers when running the database-relevant applications, compared with the commonly used block data placement strategy, i.e. the round-robin placement policy

Dates et versions

hal-01828213 , version 1 (03-07-2018)

Identifiants

Citer

Jianwei Liao, Zhigang Cai, François Trahay, Xiaoning Peng. Block placement in distributed file systems based on block access frequency. IEEE Access, 2018, 6, pp.38411 - 38420. ⟨10.1109/ACCESS.2018.2851571⟩. ⟨hal-01828213⟩
41 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More