Metadata Management for Textual Documents in Data Lakes - Archive ouverte HAL Access content directly
Conference Papers Year : 2019

Metadata Management for Textual Documents in Data Lakes

Abstract

Data lakes have emerged as an alternative to data warehouses for the storage, exploration and analysis of big data. In a data lake, data are stored in a raw state and bear no explicit schema. Thence, an efficient metadata system is essential to avoid the data lake turning to a so-called data swamp. Existing works about managing data lake metadata mostly focus on structured and semi-structured data, with little research on unstructured data. Thus, we propose in this paper a methodological approach to build and manage a metadata system that is specific to textual documents in data lakes. First, we make an inventory of usual and meaningful metadata to extract. Then, we apply some specific techniques from the text mining and information retrieval domains to extract, store and reuse these metadata within the COREL research project, in order to validate our proposals.
Fichier principal
Vignette du fichier
iceis2019skd.pdf (477.68 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-02012092 , version 1 (07-05-2019)

Licence

Identifiers

Cite

Pegdwendé Nicolas Sawadogo, Tokio Kibata, Jérôme Darmont. Metadata Management for Textual Documents in Data Lakes. 21st International Conference on Enterprise Information Systems (ICEIS 2019), May 2019, Heraklion, Greece. pp.72-83. ⟨hal-02012092⟩
250 View
613 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More