Feedback-Based Resource Allocation in MapReduce-Based Systems - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Scientific Programming Année : 2016

Feedback-Based Resource Allocation in MapReduce-Based Systems

Résumé

Containers are considered an optimized fine-grain alternative to virtual machines in cloud-based systems. Some of the approaches which have adopted the use of containers are the MapReduce frameworks. This paper makes an analysis of the use of containers in MapReduce-based systems, concluding that the resource utilization of these systems in terms of containers is suboptimal. In order to solve this, the paper describes AdaptCont, a proposal for optimizing the containers allocation in MapReduce systems. AdaptCont is based on the foundations of feedback systems. Two different selection approaches, Dynamic AdaptCont and Pool AdaptCont, are defined. Whereas Dynamic AdaptCont calculates the exact amount of resources per each container, Pool AdaptCont chooses a predefined container from a pool of available configurations. AdaptCont is evaluated for a particular case, the application master container of Hadoop YARN. As we can see in the evaluation, AdaptCont behaves much better than the default resource allocation mechanism of Hadoop YARN.

Dates et versions

hal-03360807 , version 1 (01-10-2021)

Identifiants

Citer

Bunjamin Memishi, María Pérez, Gabriel Antoniu. Feedback-Based Resource Allocation in MapReduce-Based Systems. Scientific Programming, 2016, 2016, pp.1-13. ⟨10.1155/2016/7241928⟩. ⟨hal-03360807⟩
24 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More