Reducing the effect of global synchronization in delayed gradient methods for symmetric linear systems - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Advances in Engineering Software Année : 2020

Reducing the effect of global synchronization in delayed gradient methods for symmetric linear systems

Résumé

Compared with arithmetic operation, communication cost is often the bottleneck on modern computers, and thus should be paid increasing attention when choosing algorithms. Lagged gradient methods are known for their error tolerance and fast convergence. However, it appears that their parallel behavior is not well understood. In this paper, we explore the cyclic formulations of lagged gradient methods and s-dimensional methods for reducing global synchronizations. We provide parallel implementations for these methods and propose some new variants. A comparison is then reported for different gradient iterative schemes. To illustrate the performance, we run a number of experiments, from which we conclude that our formulations perform better than traditional methods in view of both iteration count and computing time

Dates et versions

hal-04347032 , version 1 (15-12-2023)

Identifiants

Citer

Qinmeng Zou, Frédéric Magoulès. Reducing the effect of global synchronization in delayed gradient methods for symmetric linear systems. Advances in Engineering Software, 2020, ⟨10.1016/j.advengsoft.2020.102837⟩. ⟨hal-04347032⟩
11 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More