Seamlessly Scaling Applications with DAPHNE - Archive ouverte HAL
Communication Dans Un Congrès Année : 2024

Seamlessly Scaling Applications with DAPHNE

Quentin Guilloteau
Jonas H. Müller Korndörfer
  • Fonction : Auteur
  • PersonId : 1398406
Florina M. Ciorba
  • Fonction : Auteur
  • PersonId : 1398407

Résumé

When developing scientific and/or data science applications, users might start by using a scripting language to quickly produce a prototype, but eventually need to rewrite their code in a higher performance language when performance becomes a bottleneck. A similar situation arises when the applications need to scale beyond a single node. Users need to consequently adapt their code to integrate domain decomposition, synchronization, and communication libraries such as MPI. In this paper, we present ongoing work on the distributed scheduler of DAPHNE (https://daphne-eu.eu), an infrastructure for optimizing data analysis pipelines. With DAPHNE, users can write their applications once in a high level language, as they would in Python or Julia, and benefit from seamless scalability across computing nodes.
Fichier principal
Vignette du fichier
COMPAS24_DaphneSched2.pdf (490.71 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04637841 , version 1 (07-07-2024)

Identifiants

  • HAL Id : hal-04637841 , version 1

Citer

Quentin Guilloteau, Jonas H. Müller Korndörfer, Florina M. Ciorba. Seamlessly Scaling Applications with DAPHNE. COMPAS 2024 - Conférence francophone d'informatique en Parallélisme, Architecture et Système, Jul 2024, Nantes, France. ⟨hal-04637841⟩
42 Consultations
40 Téléchargements

Partager

More