Pushing the Limits of Online Auto-tuning: Machine Code Optimization in Short-Running Kernels - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2016

Pushing the Limits of Online Auto-tuning: Machine Code Optimization in Short-Running Kernels

Résumé

This article proposes an online auto-tuning approach for computing kernels. Differently from existing online auto-tuners, which regenerate code with long compilation chains from the source to the binary code, our approach consists on deploying auto-tuning directly at the level of machine code generation. This allows auto-tuning to pay off in very short-running applications. As a proof of concept, our approach is demonstrated in two benchmarks, which execute during hundreds of milliseconds to a few seconds only. In a CPU-bound kernel, the speedups achieved are 1.10 to 1.58 in average depending on the target micro-architecture, up to 2.53 in the most favourable conditions (all run-time overheads included). In a memory-bound kernel, less favourable to our runtime auto-tuning optimizations, the speedups are 1.04 to 1.10 in average, up to 1.30. Despite the short execution times of our benchmarks, the overhead of our runtime auto-tuning is between 0.2 and 4.2 % only of the total application execution times. By simulating the CPU-bound application in 11 different CPUs, we showed that, despite the clear hardware disadvantage of In-Order (IO) cores vs. Out-of-Order (OOO) equivalent cores, online auto-tuning in IO CPUs obtained an average speedup of 1.03 and an energy efficiency improvement of 39 % over the SIMD reference in OOO CPUs.
Fichier principal
Vignette du fichier
McSOC-16-preprint.pdf (741.96 Ko) Télécharger le fichier
MCSoC-16-extended-version.pdf (1.29 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01389137 , version 1 (03-11-2016)

Licence

Paternité - Pas d'utilisation commerciale

Identifiants

  • HAL Id : hal-01389137 , version 1

Citer

Fernando Endo, Damien Couroussé, Henri-Pierre Charles. Pushing the Limits of Online Auto-tuning: Machine Code Optimization in Short-Running Kernels. Proceedings of MCSOC 2016. IEEE 10th International Symposium on Embedded Multicore/Many-core Systems-on-Chip (MCSoC-16), Sep 2016, Lyon, France. ⟨hal-01389137⟩
99 Consultations
128 Téléchargements

Partager

Gmail Facebook X LinkedIn More