Towards a Semiring for Continuous Query Provenance - Archive ouverte HAL
Communication Dans Un Congrès Année : 2024

Towards a Semiring for Continuous Query Provenance

Résumé

Data provenance encompasses tracking data's origins, transformations, and derivations within a system. Provenance semirings, a mathematical framework used mainly in databases, play a key role in representing and managing provenance information and offering a structured approach to handle complex provenance queries, such as why-provenance and how-provenance, by encapsulating the essential properties of these models within their algebraic structure. In streaming scenarios, however, such models are not enough to describe the full spectrum of data provenance. Indeed, we need to account for the time dimension in streaming since data is continuously generated and processed in real time. For this reason, we study data provenance under a novel perspective, introducing When-provenance, which aims to describe the origin of the data over the time dimension and provide insights into the temporal dynamics of data transformations. This includes identifying timestamps of data generation, processing intervals, and the timing of query execution stages within defined time windows while minimizing the related performance overhead. Our contribution aims to define a when-provenance formalism to allow modification of a stream query window operator in sublinear time complexity in the input size to allow real-time, enhanced debugging, performance optimization, and audibility of streaming systems. It can also ensure compliance with temporal constraints and policies. By integrating When-provenance mechanisms, streaming query systems can achieve robust and transparent temporal tracking, leading to greater reliability and deeper insights into the temporal behaviour of data streams.
Fichier principal
Vignette du fichier
When_Provenance.pdf (521.7 Ko) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-04811584 , version 1 (29-11-2024)

Licence

Identifiants

  • HAL Id : hal-04811584 , version 1

Citer

Sebastian Labbe, Samuele Langhi, Angela Bonifati, Riccardo Tommasini. Towards a Semiring for Continuous Query Provenance. Alberto Mendelzon International Workshop on Foundations of Data Management (AMW) 2024, Oct 2024, Mexico City, Mexico. ⟨hal-04811584⟩
0 Consultations
0 Téléchargements

Partager

More