The Linux Scheduler: a Decade of Wasted Cores - Archive ouverte HAL Access content directly
Conference Papers Year :

The Linux Scheduler: a Decade of Wasted Cores

Abstract

As a central part of resource management, the OS thread scheduler must maintain the following, simple, invariant: make sure that ready threads are scheduled on available cores. As simple as it may seem, we found that this invariant is often broken in Linux. Cores may stay idle for seconds while ready threads are waiting in runqueues. In our experiments, these performance bugs caused many-fold performance degradation for synchronization-heavy scientific applications, 13% higher latency for kernel make, and a 14-23% decrease in TPC-H throughput for a widely used commercial database. The main contribution of this work is the discovery and analysis of these bugs and providing the fixes. Conventional testing techniques and debugging tools are ineffective at confirming or understanding this kind of bugs, because their symptoms are often evasive. To drive our investigation , we built new tools that check for violation of the invariant online and visualize scheduling activity. They are simple, easily portable across kernel versions, and run with a negligible overhead. We believe that making these tools part of the kernel developers' tool belt can help keep this type of bug at bay.
Fichier principal
Vignette du fichier
eurosys16-final29.pdf (364.45 Ko) Télécharger le fichier
Origin : Explicit agreement for this submission
Loading...

Dates and versions

hal-01295194 , version 1 (31-03-2016)

Identifiers

Cite

Jean-Pierre Lozi, Baptiste Lepers, Justin Funston, Fabien Gaud, Vivien Quéma, et al.. The Linux Scheduler: a Decade of Wasted Cores. EuroSys 2016, ACM, Apr 2016, London, United Kingdom. ⟨10.1145/2901318.2901326⟩. ⟨hal-01295194⟩
583 View
3813 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More