Data Ingestion from a Data Lake: The Case of Document-oriented NoSQL Databases - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

Data Ingestion from a Data Lake: The Case of Document-oriented NoSQL Databases

Résumé

Nowadays, there is a growing need to collect and analyze data from different databases. Our work is part of a medical application that must allow health professionals to analyze complex data for decision making. We propose mechanisms to extract data from a data lake and store them in a NoSQL data warehouse. This will allow us to perform, in a second time, decisional analysis facilitated by the features offered by NoSQL systems (richness of data structures, query language, access performances). In this paper, we present a process to ingest data from a Data Lake into a warehouse. The ingestion consists in (1) transferring NoSQL DBs extracted from the Data Lake into a single NoSQL DB (the warehouse), (2) merging so-called "similar" classes, and (3) converting the links into references between objects. An experiment has been performed for a medical application.

Dates et versions

hal-03758340 , version 1 (23-08-2022)

Licence

Paternité

Identifiants

Citer

Fatma Abdelhedi, Rym Jemmali, Gilles Zurfluh. Data Ingestion from a Data Lake: The Case of Document-oriented NoSQL Databases. 24th International Conference on Enterprise Information Systems (ICEIS 2022), Apr 2022, Online Streaming, France. pp.226-233, ⟨10.5220/0011068300003179⟩. ⟨hal-03758340⟩
78 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More