Fine-grained Benchmark Subsetting for System Selection - Archive ouverte HAL Access content directly
Conference Papers Year : 2014

Fine-grained Benchmark Subsetting for System Selection

(1, 2) , (2) , (2) , (2) , (1, 2)


System selection aims at finding the best architecture for a set of programs and workloads. It traditionally requires long running benchmarks. We propose a method to reduce the cost of system selection. We break down benchmarks into elementary fragments of source code, called codelets. Then, we identify two causes of redundancy: first, similar codelets; second, codelets called repeatedly. The key idea is to minimize redundancy inside the benchmark suite to speed it up. For each group of similar codelets, only one representative is kept. For codelets called repeatedly and for which the performance does not vary across calls, the number of invocations is reduced. Given an initial benchmark suite, our method produces a set of reduced benchmarks that can be used in place of the original one for system selection. We evaluate our method on the NAS SER benchmarks, producing a reduced benchmark suite 30 times faster in average than the original suite, with a maximum of 44 times. The reduced suite predicts the execution time on three target architectures with a median error between 3.9% and 8%.
Not file

Dates and versions

hal-00952256 , version 1 (26-02-2014)



Pablo de Oliveira Castro, Yuriy Kashnikov, Chadi Akel, Mihail Popov, William Jalby. Fine-grained Benchmark Subsetting for System Selection. Annual IEEE/ACM International Symposium on Code Generation and Optimization, Feb 2014, Orlando, FL, United States. pp.132:132--132:142, ⟨10.1145/2544137.2544144⟩. ⟨hal-00952256⟩


70 View
0 Download



Gmail Facebook Twitter LinkedIn More