Towards Streaming Consistency Management - Archive ouverte HAL
Communication Dans Un Congrès Année : 2024

Towards Streaming Consistency Management

Résumé

Stream processing is designed to query unbounded and timely-ordered data flows in real time while guaranteeing low latency and high throughput. Despite its roots in the database community, the most recent research on data stream management has focused on performance and neglected the role of data quality. Moreover, quality management techniques are not always feasible in streaming since the data should “keep moving.” Nevertheless, data quality issues, e.g., timeliness and completeness, become progressively more important as stream processing is applied beyond the context of analytics. For this reason, we advocate for an approach that not only allows data quality intervention as done before but also allows tracking the consistency of the records across streaming queries through provenance annotations. These annotations are associated with the input and propagated to the query results, on which a degree of inconsistency is calculated.
Towards_Streaming_Consistency_Management-2.pdf (41.46 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04692978 , version 1 (10-09-2024)

Identifiants

Citer

Samuele Langhi, Angela Bonifati, Riccardo Tommasini. Towards Streaming Consistency Management. 2024 IEEE 40th International Conference on Data Engineering (ICDE), May 2024, Utrecht, Netherlands. pp.5663-5663, ⟨10.1109/ICDE60146.2024.00462⟩. ⟨hal-04692978⟩
3 Consultations
1 Téléchargements

Altmetric

Partager

More