Controlling the Correctness of Aggregation Operations During Sessions of Interactive Analytic Queries - Archive ouverte HAL
Pré-Publication, Document De Travail Année : 2022

Controlling the Correctness of Aggregation Operations During Sessions of Interactive Analytic Queries

Eric Simon
  • Fonction : Auteur
  • PersonId : 1162729
Bernd Amann
Stéphane Gançarski

Résumé

We present a comprehensive set of conditions and rules to control the correctness of aggregation queries within an interactive data analysis session. The goal is to extend self-service data preparation and BI tools to automatically detect semantically incorrect aggregate queries on analytic tables and views built by using the common analytic operations including filter, project, join, aggregate, union, difference, and pivot. We introduce aggregable properties to describe for any attribute of an analytic table, which aggregation functions correctly aggregate the attribute along which sets of dimension attributes. These properties can also be used to formally identify attributes which are summarizable with respect to some aggregation function along a given set of dimension attributes. This is particularly helpful to detect incorrect aggregations of measures obtained through the use of non-distributive aggregation functions like average and count. We extend the notion of summarizability by introducing a new generalized summarizability condition to control the aggregation of attributes after any analytic operation. Finally, we define propagation rules which transform aggregable properties of the query input tables into new aggregable properties for the result tables, preserving summarizability and generalized summarizability.
Fichier principal
Vignette du fichier
2111.13927.pdf (1.28 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03772799 , version 1 (08-09-2022)

Identifiants

Citer

Eric Simon, Bernd Amann, Rutian Liu, Stéphane Gançarski. Controlling the Correctness of Aggregation Operations During Sessions of Interactive Analytic Queries. 2022. ⟨hal-03772799⟩
67 Consultations
41 Téléchargements

Altmetric

Partager

More