QoS-Aware and Cost-Efficient Dynamic Resource Allocation for Serverless ML Workflows - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2023

QoS-Aware and Cost-Efficient Dynamic Resource Allocation for Serverless ML Workflows

Abstract

Machine Learning (ML) workflows are increasingly deployed on serverless computing platforms to benefit from their elasticity and fine-grain pricing. Proper resource allocation is crucial to achieve fast and cost-efficient execution of serverless ML workflows (specially for hyperparameter tuning and model training). Unfortunately, existing resource allocation methods are static, treat functions equally, and rely on offline prediction, which limit their efficiency. In this paper, we introduce CE-scaling - a Cost-Efficient autoscaling framework for serverless ML workflows. During the hyperparameter tuning, CE-scaling partitions resources across stages according to their exact usage to minimize resource waste. Moreover, it incorporates an online prediction method to dynamically adjust resources during model training. We implement and evaluate CE-scaling on AWS Lambda using various ML models. Evaluation results show that compared to state-of-the-art static resource allocation methods, CE-scaling can reduce the job completion time and the monetary cost by up to 63% and 41% for hyperparameter tuning, respectively; and by up to 58% and 38% for model training.
Fichier principal
Vignette du fichier
IPDPS-2023-CR.pdf (827.5 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-04389016 , version 1 (11-01-2024)

Licence

Attribution

Identifiers

Cite

Hao Wu, Junxiao Deng, Hao Fan, Shadi Ibrahim, Song Wu, et al.. QoS-Aware and Cost-Efficient Dynamic Resource Allocation for Serverless ML Workflows. IPDPS - 2023 IEEE International Parallel and Distributed Processing Symposium, May 2023, St. Petersburg, United States. pp.886-896, ⟨10.1109/IPDPS54959.2023.00093⟩. ⟨hal-04389016⟩
18 View
36 Download

Altmetric

Share

Gmail Facebook X LinkedIn More