StreamAI: Dealing with Challenges of Continual Learning Systems for Serving AI in Production - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

StreamAI: Dealing with Challenges of Continual Learning Systems for Serving AI in Production

Résumé

How to build, deploy, update & maintain dynamic models which continuously learn from streaming data? This paper covers the industrialization aspects of these questions in production systems. In today’s fast-changing environments, organizations are faced with the crucial challenge of predictive analytics in online fashion from big data and deploying Artificial Intelligence models at scale. Applications include cyber-security, cloud infrastructure, social networks and financial markets. Online learning models that learn continuously and adapt to the potentially evolving data distributions have demonstrated efficiency for big data stream learning. However, the challenges of deploying and maintaining such models in production (serving) have stalled their adoption. In this paper, we first categorize key challenges faced by the R&D, MLOps and governance teams for deploying automated and self-training AI models in production. Next, we highlight the challenges related to stream-based online machine-learning systems. Finally, we propose StreamAI, a technology-agnostic architecture to deal with the MLOps journey (learning, serving, maintenance) of online models in production. We conclude with open research questions for AI, MLOps and software engineering to bridge the gaps between industry needs and research-oriented development.
Fichier non déposé

Dates et versions

hal-04468379 , version 1 (20-02-2024)

Identifiants

Citer

Mariam Barry, Albert Bifet, Jean-Luc Billy. StreamAI: Dealing with Challenges of Continual Learning Systems for Serving AI in Production. 45th IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice, SEIP@ICSE 2023, Melbourne, Australia, May 14-20, 2023, May 2023, Melbourne, Australia. pp.134--137, ⟨10.1109/ICSE-SEIP58684.2023.00017⟩. ⟨hal-04468379⟩
10 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More