QoS-Aware and Cost-Efficient Dynamic Resource Allocation for Serverless ML Workflows - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

QoS-Aware and Cost-Efficient Dynamic Resource Allocation for Serverless ML Workflows

Résumé

Machine Learning (ML) workflows are increasingly deployed on serverless computing platforms to benefit from their elasticity and fine-grain pricing. Proper resource allocation is crucial to achieve fast and cost-efficient execution of serverless ML workflows (specially for hyperparameter tuning and model training). Unfortunately, existing resource allocation methods are static, treat functions equally, and rely on offline prediction, which limit their efficiency. In this paper, we introduce CE-scaling - a Cost-Efficient autoscaling framework for serverless ML workflows. During the hyperparameter tuning, CE-scaling partitions resources across stages according to their exact usage to minimize resource waste. Moreover, it incorporates an online prediction method to dynamically adjust resources during model training. We implement and evaluate CE-scaling on AWS Lambda using various ML models. Evaluation results show that compared to state-of-the-art static resource allocation methods, CE-scaling can reduce the job completion time and the monetary cost by up to 63% and 41% for hyperparameter tuning, respectively; and by up to 58% and 38% for model training.
Fichier principal
Vignette du fichier
IPDPS-2023-CR.pdf (827.5 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04389016 , version 1 (11-01-2024)

Licence

Paternité

Identifiants

Citer

Hao Wu, Junxiao Deng, Hao Fan, Shadi Ibrahim, Song Wu, et al.. QoS-Aware and Cost-Efficient Dynamic Resource Allocation for Serverless ML Workflows. IPDPS - 2023 IEEE International Parallel and Distributed Processing Symposium, May 2023, St. Petersburg, United States. pp.886-896, ⟨10.1109/IPDPS54959.2023.00093⟩. ⟨hal-04389016⟩
17 Consultations
25 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More