Optimization of the processing of data streams on roughly characterized distributed resources - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Parallel and Distributed Systems Année : 2016

Optimization of the processing of data streams on roughly characterized distributed resources

Résumé

The AS4DR (Adaptive Scheduling for Distributed Resources) scheduling method presented in this paper aims at maximizing throughput, when processing several data streams by divisible load applications on star-shaped distributed memory platforms, with available speeds for communicating and computing which may be poorly estimated, or varying over time. The total workload is supposed to be unknown. According to the computation cost model, AS4DR can either maximize throughput, or CPU utilization by avoiding datastarvation of the computing units. An experimental assessment of the adaptation of the workload distribution to the variation of the communicating and computing speeds has been performed that shows that the use of AS4DR can significantly improve the throughput. This paper also experimentally assesses a resource selection method to set up star-shaped clusters of distributed resources, so as to process efficiently a set of data streams with AS4DR.
Fichier non déposé

Dates et versions

hal-01261639 , version 1 (25-01-2016)

Identifiants

Citer

Daniel Millot, Christian Parrot. Optimization of the processing of data streams on roughly characterized distributed resources. IEEE Transactions on Parallel and Distributed Systems, 2016, 27 (5), pp.1415 - 1429. ⟨10.1109/TPDS.2015.2447515⟩. ⟨hal-01261639⟩
36 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More