OFC: an opportunistic caching system for FaaS platforms - Archive ouverte HAL Access content directly
Conference Papers Year : 2021

OFC: an opportunistic caching system for FaaS platforms

(1, 2) , (3, 4, 5) , (6) , (2) , (7) , (1) , (8) , (9) , (10, 11) , (1) , (6) , (2, 6)
1
2
3
4
5
6
7
8
9
10
11
Josiane Kouam
Jinho Hwang
  • Function : Author

Abstract

Cloud applications based on the "Functions as a Service" (FaaS) paradigm have become very popular. Yet, due to their stateless nature, they must frequently interact with an external data store, which limits their performance. To mitigate this issue, we introduce OFC, a transparent, vertically and horizontally elastic in-memory caching system for FaaS platforms, distributed over the worker nodes. OFC provides these benefits cost-effectively by exploiting two common sources of resource waste: (i) most cloud tenants overprovision the memory resources reserved for their functions because their footprint is non-trivially input-dependent and (ii) FaaS providers keep function sandboxes alive for several minutes to avoid cold starts. Using machine learning models adjusted for typical function input data categories (e.g., multimedia formats), OFC estimates the actual memory resources required by each function invocation and hoards the remaining capacity to feed the cache. We build our OFC prototype based on enhancements to the OpenWhisk FaaS platform, the Swift persistent object store, and the RAM-Cloud in-memory store. Using a diverse set of workloads, we show that OFC improves by up to 82 % and 60 % respectively the execution time of single-stage and pipelined functions.
Fichier principal
Vignette du fichier
main.pdf (2.89 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03211416 , version 1 (28-04-2021)

Identifiers

Cite

Djob Mvondo, Mathieu Bacou, Kevin Nguetchouang, Stéphane Pouget, Josiane Kouam, et al.. OFC: an opportunistic caching system for FaaS platforms. EUROSYS 2021 - 16th European Conference on Computer Systems, Apr 2021, Edinburgh (online), United Kingdom. pp.228-244, ⟨10.1145/3447786.3456239⟩. ⟨hal-03211416⟩
281 View
633 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More