Computing Large 2D Convolutions on GPU Efficiently with the im2tensor Algorithm - Archive ouverte HAL
Article Dans Une Revue Journal of Real-Time Image Processing Année : 2022

Computing Large 2D Convolutions on GPU Efficiently with the im2tensor Algorithm

Résumé

Attaining the best possible throughput when computing convolutions is a challenge for signal and image processing systems, be they HPC (High-Performance Computing) machines or embedded real-time targets. This importance is highlighted by the numerous methods and implementations available, often optimized for particular settings: small batched kernels or very large kernels, for example. In the meantime, GPUs (Graphics Processing Units) have become a first-class architecture for real-time and embedded processing. The power offered by those chips stems from their parallel nature, and this advantage has been exploited for convolutions in several libraries. Even more recently, the introduction of tensor cores on NVIDIA GPUs has opened up new limits in terms of attainable FLOPS (Floating-Point Operations per Second). For reaching that performance, GPU applications must use GEMMs (GEneral Matrix Multiplications), that tensor cores accelerate. We then developed an efficient GEMM-based 2D convolution algorithm in a general setting. On relatively large kernels (30 ∼ 50-pixel wide), im2tensor is, to the best of our knowledge, the fastest method for computing 2D convolutions. We provide detailed performance analysis for different scenarios: small (1024×1024) and large (4096×4096) images, with convolutions kernels of sizes ranging 1 to 60-pixel wide, on two GPU cards: Jetson AGX Xavier (embedded) and Titan V (server-class). Moreover, the accuracy of im2tensor surpasses non-GEMM based methods, thanks to the larger-precision
Fichier principal
Vignette du fichier
Article.pdf (1.17 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03742005 , version 1 (02-08-2022)

Identifiants

Citer

Mickael Seznec, Nicolas Gac, François Orieux, Alvin Sashala Naik. Computing Large 2D Convolutions on GPU Efficiently with the im2tensor Algorithm. Journal of Real-Time Image Processing, 2022, 19, pp.1035-1047. ⟨10.1007/s11554-022-01240-0⟩. ⟨hal-03742005⟩
89 Consultations
1035 Téléchargements

Altmetric

Partager

More