Hector: A Framework to Design and Evaluate Scheduling Strategies in Persistent Key-Value Stores - Archive ouverte HAL
Communication Dans Un Congrès Année : 2023

Hector: A Framework to Design and Evaluate Scheduling Strategies in Persistent Key-Value Stores

Résumé

Key-value stores distribute data across several storage nodes to handle large amounts of parallel requests. Proper scheduling of these requests impacts the quality of service, as measured by achievable throughput and (tail) latencies. In addition to scheduling, performance heavily depends on the nature of the workload and the deployment environment. It is, unfortunately, difficult to evaluate different scheduling strategies consistently under the same operational conditions. Moreover, such strategies are often hard-coded in the system, limiting flexibility. We present Hector, a modular framework for implementing and evaluating scheduling policies in Apache Cassandra. Hector enables users to select among several options for key components of the scheduling workflow, from the request propagation via replica selection to the local ordering of incoming requests at a storage node. We demonstrate the capabilities of Hector by comparing strategies in various settings. For example, we find that leveraging cache locality effects may be of particular interest: we propose a new replica selection strategy, called Popularity-Aware, that can support 6 times the maximum throughput of the default algorithm under specific key access patterns. We also show that local scheduling policies have a significant effect when parallelism at each storage node is limited.
Fichier principal
Vignette du fichier
paper.pdf (673.81 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04158577 , version 1 (11-07-2023)

Identifiants

  • HAL Id : hal-04158577 , version 1

Citer

Louis-Claude Canon, Anthony Dugois, Loris Marchal, Etienne Rivière. Hector: A Framework to Design and Evaluate Scheduling Strategies in Persistent Key-Value Stores. ICPP 2023 - 52nd International Conference on Parallel Processing, Aug 2023, Salt Lake City, United States. ⟨hal-04158577⟩
82 Consultations
173 Téléchargements

Partager

More