Article Dans Une Revue SIAM Journal on Scientific Computing Année : 2025

Error Analysis of Matrix Multiplication with Narrow Range Floating-Point Arithmetic

Mantas Mikaitis
  • Fonction : Auteur
  • PersonId : 1405717

Résumé

High-performance computing hardware now supports many different floating-point formats, from 64 bits to only 4 bits. While the effects of reducing precision in numerical linear algebra computations have been extensively studied, some of these low precision formats also possess a very narrow range of representable values, meaning underflow and overflow are very likely. The goal of this article is to analyze the consequences of this narrow range on the accuracy of matrix multiplication. We describe a simple scaling that can prevent overflow while minimizing underflow. We carry out an error analysis to bound the underflow errors and show that they should remain dominated by the rounding errors in most practical scenarios. We also show that this conclusion remains true when multiword arithmetic is used. We perform extensive numerical experiments that confirm that the narrow range of low precision arithmetics should not significantly affect the accuracy of matrix multiplication—provided a suitable scaling is used.

Fichier principal
Vignette du fichier
manuscript.pdf (410.94 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-04671474 , version 1 (14-08-2024)
hal-04671474 , version 2 (15-03-2025)

Licence

Identifiants

Citer

Theo Mary, Mantas Mikaitis. Error Analysis of Matrix Multiplication with Narrow Range Floating-Point Arithmetic. SIAM Journal on Scientific Computing, 2025, 47 (4), pp.B785-B800. ⟨10.1137/24M1685109⟩. ⟨hal-04671474v2⟩
2301 Consultations
1077 Téléchargements

Altmetric

Partager

  • More