Conference Papers Year : 2014

Deviation Estimation between Distributed Data Streams

Abstract

The analysis of massive data streams is fundamental in many monitoring applications. In particular, for networks operators, it is a recurrent and crucial issue to determine whether huge data streams, received at their monitored devices, are correlated or not as it may reveal the presence of malicious activities in the network system. We propose a metric, called codeviation, that allows to evaluate the correlation between distributed streams. This metric is inspired from classical metric in statistics and probability theory, and as such allows us to understand how observed quantities change together, and in which proportion. We then propose to estimate the codeviation in the data stream model. In this model, functions are estimated on a huge sequence of data items, in an online fashion, and with a very small amount of memory with respect to both the size of the input stream and the values domain from which data items are drawn. We give upper and lower bounds on the quality of the codeviation, and provide both local and distributed algorithms that additively approximates the codeviation among n data streams by using O(1/ε ln (1/δ) (log N + (n+1) log m)) bits of space, where N is the domain value from which data items are drawn, and m is the maximal stream's length. To the best of our knowledge, such a metric has never been proposed so far

Fichier principal
Vignette du fichier
PID3096993.pdf (272.76 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Licence
Loading...

Dates and versions

hal-00998702 , version 1 (02-06-2014)

Licence

Identifiers

Cite

Emmanuelle Anceaume, Yann Busnel. Deviation Estimation between Distributed Data Streams. 10th European Dependable Computing Conference (EDCC 2014), May 2014, Newcastle, United Kingdom. pp.35-45, ⟨10.1109/EDCC.2014.27⟩. ⟨hal-00998702⟩
548 View
575 Download

Altmetric

Share

  • More