LEAF: Navigating Concept Drift in Cellular Networks - Archive ouverte HAL
Article Dans Une Revue Proceedings of the ACM on Networking Année : 2023

LEAF: Navigating Concept Drift in Cellular Networks

Shinan Liu
Francesco Bronzino
Paul Schmitt
Arjun Nitin Bhagoji
Nick Feamster
Hector Garcia Crespo
Timothy Coyle
Brian Ward

Résumé

Operational networks commonly rely on machine learning models for many tasks, including detecting anomalies, inferring application performance, and forecasting demand. Yet, model accuracy can degrade due to concept drift, whereby the relationship between the features and the target to be predicted changes. Mitigating concept drift is an essential part of operationalizing machine learning models in general, but is of particular importance in networking's highly dynamic deployment environments. In this paper, we first characterize concept drift in a large cellular network for a major metropolitan area in the United States. We find that concept drift occurs across many important key performance indicators (KPIs), independently of the model, training set size, and time interval---thus necessitating practical approaches to detect, explain, and mitigate it. We then show that frequent model retraining with newly available data is not sufficient to mitigate concept drift, and can even degrade model accuracy further. Finally, we develop a new methodology for concept drift mitigation, Local Error Approximation of Features (LEAF). LEAF works by detecting drift; explaining the features and time intervals that contribute the most to drift; and mitigates it using forgetting and over-sampling. We evaluate LEAF against industry-standard mitigation approaches (notably, periodic retraining) with more than four years of cellular KPI data. Our initial tests with a major cellular provider in the US show that LEAF consistently outperforms periodic and triggered retraining on complex, real-world data while reducing costly retraining operations.
Fichier principal
Vignette du fichier
paper.pdf (6.39 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04223362 , version 1 (29-09-2023)

Identifiants

Citer

Shinan Liu, Francesco Bronzino, Paul Schmitt, Arjun Nitin Bhagoji, Nick Feamster, et al.. LEAF: Navigating Concept Drift in Cellular Networks. Proceedings of the ACM on Networking, 2023, 1 (2), pp.7. ⟨10.1145/3609422⟩. ⟨hal-04223362⟩
31 Consultations
38 Téléchargements

Altmetric

Partager

More