SOKNL: A novel way of integrating K-nearest neighbours with adaptive random forest regression for data streams - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Data Mining and Knowledge Discovery Année : 2022

SOKNL: A novel way of integrating K-nearest neighbours with adaptive random forest regression for data streams

Résumé

Most research in machine learning for data streams has focused on classification algorithms, whereas regression methods have received a lot less attention. This paper proposes Self-Optimising K-Nearest Leaves (SOKNL), a novel forest-based algorithm for streaming regression problems. Specifically, the Adaptive Random Forest Regression, a state-of-the-art online regression algorithm is extended like this: in each leaf, a representative data point – also called centroid – is generated by compressing the information from all instances in that leaf. During the prediction step, instead of letting all trees in the forest participate, the distances between the input instance and all centroids from relevant leaves are calculated, only k trees that possess the smallest distances are utilised for the prediction. Furthermore, we simplify the algorithm by introducing a mechanism for tuning the k values, which is dynamically and automatically optimised based on historical information. This new algorithm produces promising predictive results and achieves a superior ranking according to statistical testing when compared with several standard stream regression methods over typical benchmark datasets. This improvement incurs only a small increase in runtime and memory consumption over the basic Adaptive Random Forest Regressor.

Dates et versions

hal-04468387 , version 1 (20-02-2024)

Identifiants

Citer

Yibin Sun, Bernhard Pfahringer, Heitor Murilo Gomes, Albert Bifet. SOKNL: A novel way of integrating K-nearest neighbours with adaptive random forest regression for data streams. Data Mining and Knowledge Discovery, 2022, 36 (5), pp.2006--2032. ⟨10.1007/S10618-022-00858-9⟩. ⟨hal-04468387⟩
5 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More