Weighted Scheduling of Time-Sensitive Coflows - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Cloud Computing Année : 2024

Weighted Scheduling of Time-Sensitive Coflows

Résumé

Datacenter networks commonly facilitate the transmission of data in distributed computing frameworks through coflows, which are collections of parallel flows associated with a common task. Most of the existing research has concentrated on scheduling coflows to minimize the time required for their completion, i.e., to optimize the average dispatch rate of coflows in the network fabric. Nevertheless, modern applications often produce coflows that are specifically intended for online services and mission-crucial computational tasks, necessitating adherence to specific deadlines for their completion. In this paper, we introduce WDCoflow, a new algorithm to maximize the weighted number of coflows that complete before their deadline. By combining a dynamic programming algorithm along with parallel inequalities, our heuristic solution performs at once coflow admission control and coflow prioritization, imposing a $\sigma$-order on the set of coflows. With extensive simulation, we demonstrate the effectiveness of our algorithm in improving up to $3\times$ more coflows that meet their deadline in comparison the best SoA solution, namely CS-MHA. Furthermore, when weights are used to differentiate coflow classes, WDCoflow is able to improve the admission per class up to $4\times$, while increasing the average weighted coflow admission rate.
Fichier principal
Vignette du fichier
brun2024weighted.pdf (3.4 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04632943 , version 1 (03-07-2024)

Identifiants

Citer

Olivier Brun, Rachid El-Azouzi, Quang-Trung Luu, Francesco De Pellegrini, Balakrishna Prabhu, et al.. Weighted Scheduling of Time-Sensitive Coflows. IEEE Transactions on Cloud Computing, 2024, 12 (2), pp.644-658. ⟨10.1109/TCC.2024.3384514⟩. ⟨hal-04632943⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More