IRIS: Online Reconfiguration of Distributed NoSQL Databases for Dynamic Workloads - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail (Preprint/Prepublication) Année : 2022

IRIS: Online Reconfiguration of Distributed NoSQL Databases for Dynamic Workloads

Paul C Wood
  • Fonction : Auteur
  • PersonId : 1109171
Subrata Mitra
  • Fonction : Auteur
Somali Chaterji
  • Fonction : Auteur
  • PersonId : 1109172
Saurabh Bagchi
  • Fonction : Auteur
  • PersonId : 1041097

Résumé

Reconfiguring NoSQL databases in the face of changing workload patterns is crucial for maximizing database throughput. However, this is challenging because of the large configuration parameter search space with complex interdependencies among parameters. While stateof-the-art systems can automatically identify close-tooptimal configurations for static workloads, they suffer for dynamic workloads. This happens due to the following two fundamental limitations. First, they do not account for performance degradation due to database restarting (often needed to apply the new configurations), and second, they overlook the application's availability requirements during reconfiguration. Our solution, IRIS, addresses both these shortcomings and we demonstrate its effectiveness for a multi-tenant, global-scale metagenomics pipeline called MG-RAST and an HPC data analytics job queue, both of which have dynamically changing workloads.We compare the benefit of IRIS in throughput over the default, a static configuration, and a theoretically ideal solution.
Fichier principal
Vignette du fichier
iris_hal22.pdf (1.18 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03891081 , version 1 (09-12-2022)

Identifiants

  • HAL Id : hal-03891081 , version 1

Citer

Ashraf Mahgoub, Paul C Wood, Subrata Mitra, Folker Meyer, Somali Chaterji, et al.. IRIS: Online Reconfiguration of Distributed NoSQL Databases for Dynamic Workloads. 2022. ⟨hal-03891081⟩
34 Consultations
28 Téléchargements

Partager

Gmail Mastodon Facebook X LinkedIn More