Toward scheduling I/O request of Mapreduce tasks based on Markov model - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2015

Toward scheduling I/O request of Mapreduce tasks based on Markov model

Résumé

In Cloud storage of multiple CPU cores, many Mapreduce applications may run in parallel on each compute node and collocate with local Disks storage. These Disks storage are shared by multiple applications that use full CPU power of the node. Each application tends to issue contigu- ous I/O requests in parallel to the same Disk; however if large number of Mapreduce tasks enters the I/O phase at the same time, the requests from the same task may be interrupted by the requests of other tasks. Then, the I/O nodes receive these requests as non-contiguous way under I/O con- tention. This interleaved access pattern causes performance degradation for Mapreduce application, this is particularly important when writing intermediate files by multiple tasks in parallel to the shared Disk stor- age. In order to overcome this problem, we have proposed approach for optimizing write access for Mapreduce application. The contributions of this paper are: 1) analyze the open issues on scheduling access request of Mapreduce workload; 2) propose framework for scheduling and predicting I/O request of Mapreduce application; 3) describe each role of compo- nent that intervenes in the scheduling theses I/O request on Block-level of storage server to provide contiguous access
Fichier non déposé

Dates et versions

hal-01269602 , version 1 (05-02-2016)

Identifiants

Citer

Sonia Ikken, Eric Renault, M. Tahar Kechadi, Abdelkamel Tari. Toward scheduling I/O request of Mapreduce tasks based on Markov model. MSPN 2015 : First International Conference on Mobile, Secure and Programmable Networking , Jun 2015, Paris, France. pp.78 - 89, ⟨10.1007/978-3-319-25744-0_7⟩. ⟨hal-01269602⟩
29 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More