Generating data transfers for distributed GPU parallel programs - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Journal of Parallel and Distributed Computing Année : 2013

Generating data transfers for distributed GPU parallel programs

Frédérique Silber-Chaussumier
  • Fonction : Auteur
  • PersonId : 950668
Rachid Habel
  • Fonction : Auteur
  • PersonId : 770433
  • IdRef : 190410671

Résumé

Nowadays, high performance applications exploit multiple level architectures, due to the presence of hardware accelerators like GPUs inside each computing node. Data transfers occur at two different levels: inside the computing node between the CPU and the accelerators and between computing nodes. We consider the case where intra-node parallelism is handled with HMPP compiler directives and message-passing programming with MPI is used to program inter-node communications. This way of programming on such an heterogeneous architecture is costly and error-prone. In this paper, we specifically demonstrate the transformation of HMPP programs designed to exploit a single computing node equipped with a GPU into an heterogeneous HMPP+MPI exploiting multiple GPUs located on different computing nodes. The STEP tool focuses on generating communications combining both powerful static analyses and runtime execution to reduce the volume of communications. Our source-to-source transformation is implemented inside the PIPS workbench. We detail the generated source program of the jacobi kernel and show that the execution times and speedups are encouraging. At last we give some directions for improvement of the tool

Dates et versions

hal-00925733 , version 1 (08-01-2014)

Identifiants

Citer

Frédérique Silber-Chaussumier, Alain Muller, Rachid Habel. Generating data transfers for distributed GPU parallel programs. Journal of Parallel and Distributed Computing, 2013, 73 (12), pp.1649-1660. ⟨10.1016/j.jpdc.2013.07.022⟩. ⟨hal-00925733⟩
28 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More