Selecting Benchmark Combinations for the Evaluation of Multicore Throughput - Archive ouverte HAL Access content directly
Conference Papers Year : 2013

Selecting Benchmark Combinations for the Evaluation of Multicore Throughput

Ricardo A. Velasquez
  • Function : Author
  • PersonId : 913940
Pierre Michaud
  • Function : Author
  • PersonId : 738135
  • IdHAL : pmichaud
André Seznec


Most high-performance processors today are able to execute multiple threads of execution simultaneously. Threads share processor resources, like the last-level cache, which may decrease throughput in a non obvious way, depending on threads' characteristics. Computer architects usually study multiprogrammed workloads by considering a set of benchmarks and some combinations of these benchmarks. Because detailed microarchitecture simulators are slow, we want a subset of combinations that is as small as possible, yet representative. However, there is no standard method for selecting such sample, and different authors have used different methods. It is not clear how the choice of a particular sample impacts the conclusions of a study. We propose and compare different sampling methods for defining multiprogrammed workloads for computer architecture studies. We evaluate their effectiveness with a case study, the comparison of several multicore last-level cache replacement policies. We show that random sampling, the simplest method, is a possible way to define a representative workload sample, provided the sample is large enough. We propose a method for estimating the required sample size based on fast approximate simulation. We propose a new method, workload stratification, which is very effective at reducing the sample size in situations where random sampling would require large samples.
Fichier principal
Vignette du fichier
ispass2013_final.pdf (804.92 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-00788824 , version 1 (15-02-2013)



Ricardo A. Velasquez, Pierre Michaud, André Seznec. Selecting Benchmark Combinations for the Evaluation of Multicore Throughput. International Symposium on Performance Analysis of Systems and Software, Apr 2013, Austin, United States. ⟨10.1109/ISPASS.2013.6557168⟩. ⟨hal-00788824⟩
465 View
345 Download



Gmail Facebook X LinkedIn More