IRIS-DS: A New Approach for Identifiers and References Discovery in Document Stores - Archive ouverte HAL
Communication Dans Un Congrès Année : 2021

IRIS-DS: A New Approach for Identifiers and References Discovery in Document Stores

Résumé

NoSQL stores offer a new cost-effective and schema-free system. Although it is widely accepted today, Business Intelligence & Analytics (BI&A) remains associated with relational databases. Exploiting schema-free data for analytical purposes is issuing a challenge since it requires reviewing all the BI&A phases, particularly the Extract-Transform-Load (ETL) process, to fit big data sources as document stores. In the ETL process, the join of several collections, with a lack of explicitly known join fields, is a significant challenge. Detecting these fields manually is time and effort consuming, and even infeasible in large-scale datasets. In this paper, we study the problem of discovering join fields automatically, and introduce an algorithm to detect both identifiers and references on several document stores. The modus operandi of our approach underscores two core stages: (i) discovery of identifier candidates; and (ii) identifying candidate pairs of identifier and reference fields. We use scoring features and pruning rules based on both syntactic and semantic aspects to efficiently discover true candidates from a huge number of initial ones. Finally, we report our experimental findings that show very promising results.
Fichier principal
Vignette du fichier
0096.pdf (982.5 Ko) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-03184465 , version 1 (20-04-2021)

Licence

Identifiants

Citer

Manel Souibgui, Faten Atigui, Sadok Ben Yahia, Samira Si-Said Cherfi. IRIS-DS: A New Approach for Identifiers and References Discovery in Document Stores. 54th Hawaii International Conference on System Sciences (HICSS 2021), Jan 2021, Hawaii, United States. pp.970-979, ⟨10.24251/HICSS.2021.118⟩. ⟨hal-03184465⟩
176 Consultations
133 Téléchargements

Altmetric

Partager

More