PRESPS: a PREdictive model to determine the number of replicas of the operators in Stream Processing Systems - Archive ouverte HAL
Communication Dans Un Congrès Année : 2023

PRESPS: a PREdictive model to determine the number of replicas of the operators in Stream Processing Systems

Résumé

Stream Processing Systems (SPS) are used to process large amounts of data in real time, which are designed as directed acyclic graph (DAG). The vertices correspond to operators and the edges to data stream. Each component is deployed distributed in an infrastructure, which is parallelized. In this paper we propose a predictive model to dynamically and predictively determine the number of replicas required by each SPS operator, based on the input data, per operator event queue and execution time. We have performed preliminary experiments of our solution with another existing solution using a Twitter Stream, deployed on Google Cloud Platform (GCP).
Fichier principal
Vignette du fichier
compas2023-final26.pdf (220.74 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04153951 , version 1 (06-07-2023)

Licence

Identifiants

  • HAL Id : hal-04153951 , version 1

Citer

Daniel Wladdimiro, Luciana Arantes, Nicolas Hidalgo, Pierre Sens. PRESPS: a PREdictive model to determine the number of replicas of the operators in Stream Processing Systems. Compas 2023 - Conférence francophone d'informatique en Parallélisme, Architecture et Système, Jul 2023, Annecy, France. ⟨hal-04153951⟩
103 Consultations
29 Téléchargements

Partager

More