Workflow fairness control on online and non-clairvoyant distributed computing platforms - Archive ouverte HAL
Communication Dans Un Congrès Année : 2013

Workflow fairness control on online and non-clairvoyant distributed computing platforms

Rafael Ferreira da Silva
Tristan Glatard
  • Fonction : Auteur
  • PersonId : 916316

Résumé

Fairly allocating distributed computing resources among workflow executions is critical to multi-user platforms. However, this problem remains mostly studied in clairvoyant and offline conditions, where task durations on resources are known, or the workload and available resources do not vary along time. We consider a non-clairvoyant, online fairness problem where the platform workload, task costs and resource characteristics are unknown and not stationary. We propose a fairness control loop which assigns task priorities based on the fraction of pending work in the workflows. Workflow characteristics and performance on the target resources are estimated progressively, as information becomes available during the execution. Our method is implemented and evaluated on 4 different applications executed in production conditions on the European Grid Infrastructure. Results show that our technique reduces slowdown variability by 3 to 7 compared to first-come-first-served.
Fichier principal
Vignette du fichier
europar2013-fairness.pdf (411.35 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00849993 , version 1 (02-08-2013)

Identifiants

  • HAL Id : hal-00849993 , version 1

Citer

Rafael Ferreira da Silva, Tristan Glatard, Frédéric Desprez. Workflow fairness control on online and non-clairvoyant distributed computing platforms. 19th International Conference Euro-Par 2013, Aug 2013, Aachen, Germany. pp.102-113. ⟨hal-00849993⟩
314 Consultations
299 Téléchargements

Partager

More