Pré-Publication, Document De Travail Année : 2024

High Performance Interconnect Technologies for Supercomputing

Résumé

High-performance computing (HPC) is contributing significantly to scientific progression thanks to its abundant computing power. With recent breakthroughs in natural language processing (NLP), HPC has become indispensable in driving their success, owing to its capacity to train large language models (LLMs). HPC systems not only demonstrate their importance in scientific computing but also in machine learning and generative artificial intelligence. This unprecedented computing power is firstly due to the development of newer computing resources: CPUs, GPUs, FPGAs, etc. However, the progress in interconnect networking, which links hundreds of thousands of compute nodes, should not be overlooked. This survey investigates current popular interconnect topologies driving the most powerful supercomputers.

Fichier principal
Vignette du fichier
interconnect_survey.pdf (619.15 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-04464809 , version 1 (19-02-2024)

Licence

Identifiants

  • HAL Id : hal-04464809 , version 1

Citer

Yuanyong Liang, Arnold Galindo, Chike Yuan. High Performance Interconnect Technologies for Supercomputing. 2024. ⟨hal-04464809⟩
253 Consultations
3664 Téléchargements

Partager

  • More