Adaptive process migrations in coupled applications for exchanging data in local file cache - Archive ouverte HAL
Article Dans Une Revue ACM Transactions on Autonomous and Adaptive Systems Année : 2018

Adaptive process migrations in coupled applications for exchanging data in local file cache

Résumé

Many problems in science and engineering are usually emulated as a set of mutually interacting models, resulting in a coupled or multiphysics application. These component models show challenges originating from their interdisciplinary nature and from their computational and algorithmic complexities. In general, these models are independently developed and maintained, so that they commonly employ the global file system for exchanging their data in the coupled application. To effectively use the local file cache on the compute node for exchanging the data among the processes of such applications, and consequently boosting I/O performance, this article presents a novel mechanism to migrate a process from one compute node to another node on the basis of block I/O dependency. In this newly proposed mechanism, the block I/O dependency between two involved processes running on the different nodes is profiled as block access similarity by taking advantage of the Cohen's kappa statistic. Then, the process is supposed to be dynamically migrated from its source node to the destination node, on which there is another process having heavy block I/O dependency. As a result, both processes can exchange their data by utilizing the local file cache instead of the global file system to reduce I/O time. The experimental results demonstrate that the I/O performance can be significantly improved, and the time required for executing the application can be resultantly decreased, as expected
Fichier non déposé

Dates et versions

hal-01870346 , version 1 (07-09-2018)

Identifiants

Citer

Jianwei Liao, Zhigang Cai, François Trahay, Zhou Jun, Guoqiang Xiao. Adaptive process migrations in coupled applications for exchanging data in local file cache. ACM Transactions on Autonomous and Adaptive Systems, 2018, 13 (2), pp.Article n° 9 -. ⟨10.1145/3226027⟩. ⟨hal-01870346⟩
33 Consultations
0 Téléchargements

Altmetric

Partager

More