Fingerprinting Concepts in Data Streams with Supervised and Unsupervised Meta-Information - Archive ouverte HAL
Communication Dans Un Congrès Année : 2021

Fingerprinting Concepts in Data Streams with Supervised and Unsupervised Meta-Information

Résumé

Streaming sources of data are becoming more common as the ability to collect data in real-time grows. A major concern in dealing with data streams is concept drift, a change in the distribution of data over time, for example, due to changes in environmental conditions. Representing concepts (stationary periods featuring similar behaviour) is a key idea in adapting to concept drift. By testing the similarity of a concept representation to a window of observations, we can detect concept drift to a new or previously seen recurring concept. Concept representations are constructed using meta-information features, values describing aspects of concept behaviour. We find that previously proposed concept representations rely on small numbers of meta-information features. These representations often cannot distinguish concepts, leaving systems vulnerable to concept drift. We propose FiCSUM, a general framework to represent both supervised and unsupervised behaviours of a concept in a fingerprint, a vector of many distinct meta-information features able to uniquely identify more concepts. Our dynamic weighting strategy learns which meta-information features describe concept drift in a given dataset, allowing a diverse set of meta-information features to be used at once. FiCSUM outperforms state-of-the-art methods over a range of 11 real world and synthetic datasets in both accuracy and modeling underlying concept drift.
Fichier non déposé

Dates et versions

hal-04468422 , version 1 (20-02-2024)

Identifiants

Citer

Ben Halstead, Yun Sing Koh, Patricia Riddle, Mykola Pechenizkiy, Albert Bifet, et al.. Fingerprinting Concepts in Data Streams with Supervised and Unsupervised Meta-Information. 37th IEEE International Conference on Data Engineering, ICDE 2021, Chania, Greece, April 19-22, 2021, Apr 2021, Chania, Greece. pp.1056--1067, ⟨10.1109/ICDE51399.2021.00096⟩. ⟨hal-04468422⟩
30 Consultations
0 Téléchargements

Altmetric

Partager

More