Big continuous data: dealing with velocity by composing event streams - Archive ouverte HAL Access content directly
Book Sections Year : 2016

Big continuous data: dealing with velocity by composing event streams


The rate at which we produce data is growing steadily, thus creating even larger streams of continuously evolving data. Online news, micro-blogs, search queries are just a few examples of these continuous streams of user activities. The value of these streams relies in their freshness and relatedness to on-going events. Modern applications consuming these streams need to extract behaviour patterns that can be obtained by aggregating and mining statically and dynamically huge event histories. An event is the notification that a happening of interest has occurred. Event streams must be combined or aggregated to produce more meaningful information. By combining and aggregating them either from multiple producers, or from a single one during a given period of time, a limited set of events describing meaningful situations may be notified to consumers. Event streams with their volume and continuous production cope mainly with two of the characteristics given to Big Data by the 5V’s model: volume & velocity. Techniques such as complex pattern detection, event correlation, event aggregation, event mining and stream processing, have been used for composing events. Nevertheless, to the best of our knowledge, few approaches integrate different composition techniques (online and post-mortem) for dealing with Big Data velocity. This chapter gives an analytical overview of event stream processing and composition approaches: complex event languages, services and event querying systems on distributed logs. Our analysis underlines the challenges introduced by Big Data velocity and volume and use them as reference for identifying the scope and limitations of results stemming from different disciplines: networks, distributed systems, stream databases, event composition services, and data mining on traces.
Fichier principal
Vignette du fichier
vargas-etal.pdf (1.02 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01270339 , version 1 (26-02-2016)


  • HAL Id : hal-01270339 , version 1


Genoveva Vargas-Solar, Javier Alfonso Espinosa Oviedo, José-Luis Zechinelli-Martini. Big continuous data: dealing with velocity by composing event streams . Shui Yu; Song Guo. Big Data Concepts, Theories and Applications, Springer Verlag, 2016, 978-3-319-27763-9. ⟨hal-01270339⟩
237 View
502 Download


Gmail Facebook Twitter LinkedIn More