Exploratory data science on supercomputers for quantum mechanical calculations - Archive ouverte HAL
Article Dans Une Revue Electronic Structure Année : 2024

Exploratory data science on supercomputers for quantum mechanical calculations

Résumé

Abstract Literate programming—the bringing together of program code and natural language narratives—has become a ubiquitous approach in the realm of data science. This methodology is appealing as well for the domain of Density Functional Theory (DFT) calculations, particularly for interactively developing new methodologies and workflows. However, effective use of literate programming is hampered by old programming paradigms and the difficulties associated with using high performance computing (HPC) resources. Here we present two Python libraries that aim to remove these hurdles. First, we describe the PyBigDFT library, which can be used to setup materials or molecular systems and provides high-level access to the wavelet based BigDFT code. We then present the related remotemanager library, which is able to serialize and execute arbitrary Python functions on remote supercomputers. We show how together these libraries enable transparent access to HPC based DFT calculations and can serve as building blocks for rapid prototyping and data exploration.

Dates et versions

hal-04738731 , version 1 (15-10-2024)

Identifiants

Citer

William Dawson, Louis Beal, Laura Ratcliff, Martina Stella, Takahito Nakajima, et al.. Exploratory data science on supercomputers for quantum mechanical calculations. Electronic Structure, 2024, 6 (2), pp.027003. ⟨10.1088/2516-1075/ad4b80⟩. ⟨hal-04738731⟩
8 Consultations
0 Téléchargements

Altmetric

Partager

More