Parallel Distributed Productivity-aware Tree-Search using Chapel - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Concurrency and Computation: Practice and Experience Année : 2023

Parallel Distributed Productivity-aware Tree-Search using Chapel

Résumé

With the recent arrival of the exascale era, modern supercomputers are increasingly big making their programming much more complex. In addition to performance, software productivity is a major concern to choose a programming language, such as Chapel, designed for exascale computing. In this paper, we investigate the design of a parallel distributed tree-search algorithm, namely P3D-DFS, and its implementation using Chapel. The design is based on the Chapel's DistBag data structure, revisited by: (1) redefining the data structure for Depth-First tree-Search (DFS), henceforth renamed DistBag-DFS; (2) redesigning the underlying load balancing mechanism. In addition, we propose two instantiations of P3D-DFS considering the Branch-and-Bound (B&B) and Unbalanced Tree Search (UTS) algorithms. In order to evaluate how much performance is traded for productivity, we compare the Chapel-based implementations of B&B and UTS to their best-known counterparts based on traditional OpenMP (intra-node) and MPI+X (inter-node). For experimental validation using 4096 processing cores, we consider the permutation flow-shop scheduling problem for B&B and synthetic literature benchmarks for UTS. The reported results show that P3D-DFS competes with its OpenMP baselines for coarser-grained shared-memory scenarios, and with its MPI+X counterparts for distributed-memory settings, considering both performance and productivity-awareness. In the context of this work, this makes Chapel an alternative to OpenMP/MPI+X for exascale programming.
Fichier principal
Vignette du fichier
Helbecque_et_al_preprint.pdf (462.47 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Licence : CC BY - Paternité

Dates et versions

hal-04165491 , version 1 (19-07-2023)

Licence

Paternité

Identifiants

Citer

Guillaume Helbecque, Jan Gmys, Nouredine Melab, Tiago Carneiro, Pascal Bouvry. Parallel Distributed Productivity-aware Tree-Search using Chapel. Concurrency and Computation: Practice and Experience, 2023, 35 (27), pp.e7874. ⟨10.1002/cpe.7874⟩. ⟨hal-04165491⟩
37 Consultations
36 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More