Rethinking Operators Placement of Stream Data Application in the Edge - Archive ouverte HAL
Communication Dans Un Congrès Année : 2020

Rethinking Operators Placement of Stream Data Application in the Edge

Résumé

Maximum Sustainable Throughput (MST) refers to the amount of data that a Data Stream Processing (DSP) system can ingest while keeping stable performance. It has been acknowledged as an accurate metric to evaluate the performance of stream data processing. Yet, existing operators placements continue to focus on latency and throughput, not MST, as main performance objective when deploy- ing stream data applications in the Edge. In this paper, we argue that MST should be used as an optimization objective when placing operators. This is specially important in the Edge, where network bandwidth and data streams are highly dynamic. We demonstrate that through the design and evaluation of a MST-driven operators placement (based on constraint programming) for stream data applications. Through simulations, we show how existing placement strategies that target overall communications reduction often fail to keep up with the rate of data streams. Importantly, the constraint programming-based operators placement is able to sustain up to 5x increased data ingestion compared to baseline strategies.
Fichier principal
Vignette du fichier
main_hal.pdf (780.76 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02942759 , version 1 (02-11-2020)

Identifiants

Citer

Thomas Lambert, David Guyon, Shadi Ibrahim. Rethinking Operators Placement of Stream Data Application in the Edge. CIKM 2020- 29th ACM International Conference on Information and Knowledge Management, Oct 2020, Dublin, Ireland. ⟨10.1145/3340531.3412116⟩. ⟨hal-02942759⟩
326 Consultations
199 Téléchargements

Altmetric

Partager

More