Adaptive Optimal Control of MapReduce Performance, Availability and Costs - Archive ouverte HAL
Communication Dans Un Congrès Année : 2016

Adaptive Optimal Control of MapReduce Performance, Availability and Costs

Résumé

MapReduce is a popular programming model for distributed data processing and Big Data applications running on clouds. Extensive research has been conducted either to improve the dependability or to increase performance of MapReduce, ranging from adaptive and on-demand fault-tolerance solutions, adaptive task scheduling techniques to optimized job execution mechanisms. This paper investigates an optimization-based solution to control MapReduce systems in order to provide guarantees in terms of both performance and availability while reducing utilization costs. We follow a control theoretical approach for MapReduce cluster scaling and admission control. Moreover, we aim to be robust to changes in MapRe-duce and in it's environment by adapting the controller online to those changes. This paper highlights the major challenges of combining system adaptation and optimal control to take the best of both approaches. CCS Concepts • Networks → Cloud computing; • Software and its engineering → Software configuration management and version control systems; • Computer systems organization → Dependable and fault-tolerant systems and networks;
Fichier principal
Vignette du fichier
main.pdf (456.85 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01331024 , version 1 (13-06-2016)

Identifiants

  • HAL Id : hal-01331024 , version 1

Citer

Sophie Cerf, Mihaly Berekmeri, Bogdan Robu, Nicolas Marchand, Sara Bouchenak. Adaptive Optimal Control of MapReduce Performance, Availability and Costs. Feedback Computin 2016 - 11th International Workshop on Feedback Computing, Jul 2016, Wurzburg, Germany. ⟨hal-01331024⟩
708 Consultations
332 Téléchargements

Partager

More