Machine Learning to Data Management: A Round Trip - Archive ouverte HAL Access content directly
Conference Papers Year : 2018

Machine Learning to Data Management: A Round Trip

Laure Berti-Équille
Angela Bonifati
Tova Milo
  • Function : Author


With the emergence of machine learning (ML) techniques in database research, ML has already proved a tremendous potential to dramatically impact the foundations, algorithms, and models of several data management tasks, such as error detection, data cleaning, data integration, and query inference. Part of the data preparation, standardization, and cleaning processes, such as data matching and deduplication for instance, could be automated by making a ML model " learn " and predict the matches routinely. Data integration can also benefit from ML as the data to be integrated can be sampled and used to design the data integration algorithms. After the initial manual work to setup the labels, ML models can start learning from the new incoming data that are being submitted for standardization, integration, and cleaning. The more data supplied to the model, the better the ML algorithm can perform and deliver accurate results. Therefore, ML is more scalable compared to traditional and time-consuming approaches. Nevertheless, many ML algorithms require an out-of-the-box tuning and their parameters and scope are often not adapted to the problem at hand. To make an example, in cleaning and integration processes, the window sizes of values used for the ML models cannot be arbitrarily chosen and require an adaptation of the learning parameters. This tutorial will survey the recent trend of applying machine learning solutions to improve data management tasks and establish new paradigms to sharpen data error detection, cleaning, and integration at the data instance level, as well as at schema, system, and user levels.
Fichier principal
Vignette du fichier
PID5217775.pdf (105.87 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01795315 , version 1 (18-05-2018)



Laure Berti-Équille, Angela Bonifati, Tova Milo. Machine Learning to Data Management: A Round Trip. Proceedings of the 34th IEEE International Conference on Data Engineering (ICDE), Apr 2018, Paris, France. pp.1735-1738, ⟨10.1109/ICDE.2018.00226⟩. ⟨hal-01795315⟩
221 View
1050 Download



Gmail Facebook X LinkedIn More