Data Exploration with SQL using Machine Learning Techniques - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2017

Data Exploration with SQL using Machine Learning Techniques

Julien Cumin
  • Fonction : Auteur
  • PersonId : 977626
Vasile-Marian Scuturici
Sabina Surdu
  • Fonction : Auteur
  • PersonId : 1000296

Résumé

Nowadays data scientists have access to gigantic data, many of them being accessible through SQL. Despite the inherent simplicity of SQL, writing relevant and efficient SQL queries is known to be difficult, especially for databases having a large number of attributes or meaningless attribute names. In this paper, we propose a " rewriting " technique to help data scientists formulate SQL queries, to rapidly and intuitively explore their big data, while keeping user input at a minimum, with no manual tuple specification or labeling. For a user specified query, we define a negation query, which produces tuples that are not wanted in the initial query's answer. Since there is an exponential number of such negation queries, we describe a pseudo-polynomial heuristic to pick the negation closest in size to the initial query, and construct a balanced learning set whose positive examples correspond to the results desired by analysts, and negative examples to those they do not want. The initial query is reformulated using machine learning techniques and a new query, more efficient and diverse, is obtained. We have implemented a prototype and conducted experiments on real-life datasets and synthetic query workloads to assess the scalability and precision of our proposition. A preliminary qualitative experiment conducted with astrophysicists is also described.
Fichier principal
Vignette du fichier
iSQL_EDBT.pdf (453.57 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01455715 , version 1 (03-02-2017)

Identifiants

  • HAL Id : hal-01455715 , version 1

Citer

Julien Cumin, Jean-Marc Petit, Vasile-Marian Scuturici, Sabina Surdu. Data Exploration with SQL using Machine Learning Techniques. International Conference on Extending Database Technology - EDBT, Mar 2017, Venice, Italy. pp.96-107. ⟨hal-01455715⟩
628 Consultations
1589 Téléchargements

Partager

Gmail Facebook X LinkedIn More