Experience with benchmarking dependability and performance of MapReduce systems - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Performance Evaluation Année : 2016

Experience with benchmarking dependability and performance of MapReduce systems

Résumé

MapReduce provides a convenient means for distributed data processing and automatic parallel execution on clusters of machines. It has various applications and is used by several services featuring fault tolerance and scalability. Many studies investigated the dependability and performance of MapReduce, ranging from job scheduling to data placement and replication, adaptive and on-demand fault tolerance to new fault tolerance models. However, the ad-hoc and overly simplified setting used to evaluate most MapReduce fault tolerance and performance improvement solutions poses significant challenges to the analysis and comparison of the effectiveness of these solutions. The paper precisely addresses this issue and presents MRBS, a comprehensive benchmark suite for evaluating the dependability and performance of MapReduce systems. MRBS includes five benchmarks covering several application domains and a wide range of execution scenarios such as data-intensive vs. compute-intensive applications, or batch applications vs. online interactive applications. MRBS allows to inject various workloads, dataloads and faultloads, and produces extensive reliability, availability and performance statistics. We implemented the MRBS benchmark suite for Hadoop MapReduce, and we illustrate its use with various case studies running on Amazon EC2 and on a private cloud.
Fichier non déposé

Dates et versions

hal-01372628 , version 1 (27-09-2016)

Identifiants

Citer

Amit Sangroya, Sara Bouchenak, Damián Serrano. Experience with benchmarking dependability and performance of MapReduce systems. Performance Evaluation, 2016, Performance Evaluation, 101, pp.1-19. ⟨10.1016/j.peva.2016.04.001⟩. ⟨hal-01372628⟩
245 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More