Tail-latency aware and resource-efficient bin pack autoscaling for distributed event queues - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2024

Tail-latency aware and resource-efficient bin pack autoscaling for distributed event queues

Résumé

Distributed event queues are currently the backbone for many large-scale real-time cloud applications including smart grids, intelligent transportation, and health care monitoring. Applications (event consumers) that process events from distributed event queue are latency-sensitive. They require that a high percentile of events be served in less than a desired latency. Meeting such desired latency must be accomplished at low cost in terms of resources used. In this research, we first express the problem of targeting resource-efficient and latency-aware event consuming from distributed event queues as a bin pack problem. This bin pack depends on the arrival rate of events, the number of events in the queue backlog, and the maximum consumption rate of event consumers. We show that the proposed bin pack solution outperforms a linear autoscaling solution by 3.5% up to 10% in terms of latency SLA. Furthermore, we discuss how dynamic event consumers provisioning in distributed event queues necessitates a blocking synchronization protocol. We show that this blocking synchronization protocol is at conflict with meeting a desired latency for high percentile of events. Hence, we propose an extension to the bin pack autoscaler logic in order to reduce the tail latency caused by the events accumulated during the blocking synchronisation protocol.
Fichier non déposé

Dates et versions

hal-04478363 , version 1 (26-02-2024)

Identifiants

  • HAL Id : hal-04478363 , version 1

Citer

Mazen Ezzeddine, Francoise Baude, Fabrice Huet. Tail-latency aware and resource-efficient bin pack autoscaling for distributed event queues. CLOSER 2024 - 14th International Conference on Cloud Computing and Services Science, May 2024, Angers (FR), France. ⟨hal-04478363⟩
31 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More