The sandpile scheduler - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Cluster Computing Année : 2014

The sandpile scheduler

Juan Luis Jiménez Laredo
Bernabé Dorronsoro
  • Fonction : Auteur
Fernandes Carlos
  • Fonction : Auteur

Résumé

This paper studies a self-organized criticality (SOC) model called sandpile for dynamically load-balancing tasks arriving in the form of Bag-of-Tasks (BoTs) in large-scale decentralized system. The sandpile is designed as a decentralized agent system characterizing a cellular automaton, which works in a critical state at the edge of chaos. Depending on the state of the cellular automaton, rather different responses may occur when a new task is assigned to a resource: it may change nothing or generate avalanches that reconfigure the state of the system. The abundance of such avalanches is in power-law relation with their sizes, a scale-invariant behavior that emerges without requiring tuning or control parameters. That means that large-catastrophic-avalanches are very rare but small ones occur very often. Such an emergent pattern can be efficiently adapted for non-clairvoyant scheduling, where tasks are load balanced into computing resources trying to maximize the performance but without assuming any knowledge on the tasks features. In order to validate the algorithm design, we conduct an empirical experimentation showing that the sandpile is able to find near-optimal schedules by reacting differently to different conditions of workloads and architectures.
Fichier principal
Vignette du fichier
clustercomputing_sandpile.pdf (990.23 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02501380 , version 1 (06-03-2020)

Identifiants

Citer

Juan Luis Jiménez Laredo, Pascal Bouvry, Frédéric Guinand, Bernabé Dorronsoro, Fernandes Carlos. The sandpile scheduler: How self-organized criticality may lead to dynamic load-balancing. Cluster Computing, 2014, 17 (2), pp.191-204. ⟨10.1007/s10586-013-0328-x⟩. ⟨hal-02501380⟩
20 Consultations
91 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More