A Profile-Based AI-Assisted Dynamic Scheduling Approach for Heterogeneous Architectures - Archive ouverte HAL Access content directly
Journal Articles International Journal of Parallel Programming Year : 2022

A Profile-Based AI-Assisted Dynamic Scheduling Approach for Heterogeneous Architectures

Abstract

While heterogeneous architectures are increasing popular with High Performance Computing systems, their effectiveness depends on how efficient the scheduler is at allocating workloads onto appropriate computing devices and how communication and computation can be overlapped. With different types of resources integrated into one system, the complexity of the scheduler correspondingly increases. Moreover, for applications with varying problem sizes on different heterogeneous resources, the optimal scheduling approach may vary accordingly. Thus, we introduce a Profile-based AI-assisted Dynamic Scheduling approach to dynamically and adaptively adjust workloads and efficiently utilize heterogeneous resources. It combines online scheduling, application profile information, hardware mathematical modeling and offline machine learning estimation modeling to implement automatic application-device-specific scheduling for heterogeneous architectures. A hardware mathematical model provides coarse-grain computing resource selection while the profile information and offline machine learning model estimates the performance of a fine-grain workload, and an online scheduling approach dynamically and adaptively distributes the workload. Our scheduling approach is tested on control-regular applications, 2D and 3D Stencil kernels (based on a Jacobi Algorithm), and a data-irregular application, Sparse Matrix-Vector Multiplication, in an event-driven runtime system. Experimental results show that PDAWL is either onpar or far outperforms whichever yields the best results (CPU or GPU).
Fichier principal
Vignette du fichier
main_IJPP.pdf (1.51 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03606185 , version 1 (22-03-2022)

Identifiers

Cite

Tongsheng Geng, Marcos Amaris, Stéphane Zuckerman, Alfredo Goldman, Guang Gao, et al.. A Profile-Based AI-Assisted Dynamic Scheduling Approach for Heterogeneous Architectures. International Journal of Parallel Programming, 2022, 50 (1), pp.115-151. ⟨10.1007/s10766-021-00721-2⟩. ⟨hal-03606185⟩
144 View
186 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More