Optimizing Memory Allocation in a Serverless Architecture through Function Scheduling

Manish Pandey; Young Woo Kwon

doi:10.1109/CCGridW59191.2023.00056

Optimizing Memory Allocation in a Serverless Architecture through Function Scheduling

Manish Pandey, Young Woo Kwon

Kyungpook National University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

1 Scopus citations

Abstract

In a serverless architecture, a function does not fully utilize the allocated memory. Such memory over-allocation increases node utilization and wastes resources, causing cold-start and latency issues. This paper presents a fine-grained scheduling approach for a serverless architecture that aims to address the issue of over-memory allocation and improve data locality. The proposed approach estimates how much memory each function uses so that similar functions can be scheduled on the same node. As a result, it makes less use of each node and keeps the state within a single node. We evaluated our approach through the existing FaaS applications and real-world data.

Original language	English
Title of host publication	Proceedings - 23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing Workshops, CCGridW 2023
Editors	Yogesh Simmhan, Ilkay Altintas, Ana-Lucia Varbanescu, Pavan Balaji, Abhinandan S. Prasad, Lorenzo Carnevale
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	275-277
Number of pages	3
ISBN (Electronic)	9798350302080
DOIs	https://doi.org/10.1109/CCGridW59191.2023.00056
State	Published - 2023
Event	23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing Workshops, CCGridW 2023 - Bangalore, India Duration: 1 May 2023 → 4 May 2023

Publication series

Name	Proceedings - 23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing Workshops, CCGridW 2023

Conference

Conference	23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing Workshops, CCGridW 2023
Country/Territory	India
City	Bangalore
Period	1/05/23 → 4/05/23

Keywords

and resource utilization
scheduling
Serverless computing

Access to Document

10.1109/CCGridW59191.2023.00056

Cite this

Pandey, M., & Kwon, Y. W. (2023). Optimizing Memory Allocation in a Serverless Architecture through Function Scheduling. In Y. Simmhan, I. Altintas, A.-L. Varbanescu, P. Balaji, A. S. Prasad, & L. Carnevale (Eds.), Proceedings - 23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing Workshops, CCGridW 2023 (pp. 275-277). (Proceedings - 23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing Workshops, CCGridW 2023). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CCGridW59191.2023.00056

Pandey, Manish ; Kwon, Young Woo. / Optimizing Memory Allocation in a Serverless Architecture through Function Scheduling. Proceedings - 23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing Workshops, CCGridW 2023. editor / Yogesh Simmhan ; Ilkay Altintas ; Ana-Lucia Varbanescu ; Pavan Balaji ; Abhinandan S. Prasad ; Lorenzo Carnevale. Institute of Electrical and Electronics Engineers Inc., 2023. pp. 275-277 (Proceedings - 23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing Workshops, CCGridW 2023).

@inproceedings{4fac2f8bb914446e879ba379a5c61de8,

title = "Optimizing Memory Allocation in a Serverless Architecture through Function Scheduling",

abstract = "In a serverless architecture, a function does not fully utilize the allocated memory. Such memory over-allocation increases node utilization and wastes resources, causing cold-start and latency issues. This paper presents a fine-grained scheduling approach for a serverless architecture that aims to address the issue of over-memory allocation and improve data locality. The proposed approach estimates how much memory each function uses so that similar functions can be scheduled on the same node. As a result, it makes less use of each node and keeps the state within a single node. We evaluated our approach through the existing FaaS applications and real-world data.",

keywords = "and resource utilization, scheduling, Serverless computing",

author = "Manish Pandey and Kwon, {Young Woo}",

note = "Publisher Copyright: {\textcopyright} 2023 IEEE.; 23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing Workshops, CCGridW 2023 ; Conference date: 01-05-2023 Through 04-05-2023",

year = "2023",

doi = "10.1109/CCGridW59191.2023.00056",

language = "English",

series = "Proceedings - 23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing Workshops, CCGridW 2023",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "275--277",

editor = "Yogesh Simmhan and Ilkay Altintas and Ana-Lucia Varbanescu and Pavan Balaji and Prasad, {Abhinandan S.} and Lorenzo Carnevale",

booktitle = "Proceedings - 23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing Workshops, CCGridW 2023",

address = "United States",

}

Pandey, M & Kwon, YW 2023, Optimizing Memory Allocation in a Serverless Architecture through Function Scheduling. in Y Simmhan, I Altintas, A-L Varbanescu, P Balaji, AS Prasad & L Carnevale (eds), Proceedings - 23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing Workshops, CCGridW 2023. Proceedings - 23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing Workshops, CCGridW 2023, Institute of Electrical and Electronics Engineers Inc., pp. 275-277, 23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing Workshops, CCGridW 2023, Bangalore, India, 1/05/23. https://doi.org/10.1109/CCGridW59191.2023.00056

Optimizing Memory Allocation in a Serverless Architecture through Function Scheduling. / Pandey, Manish; Kwon, Young Woo.
Proceedings - 23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing Workshops, CCGridW 2023. ed. / Yogesh Simmhan; Ilkay Altintas; Ana-Lucia Varbanescu; Pavan Balaji; Abhinandan S. Prasad; Lorenzo Carnevale. Institute of Electrical and Electronics Engineers Inc., 2023. p. 275-277 (Proceedings - 23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing Workshops, CCGridW 2023).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Optimizing Memory Allocation in a Serverless Architecture through Function Scheduling

AU - Pandey, Manish

AU - Kwon, Young Woo

PY - 2023

Y1 - 2023

N2 - In a serverless architecture, a function does not fully utilize the allocated memory. Such memory over-allocation increases node utilization and wastes resources, causing cold-start and latency issues. This paper presents a fine-grained scheduling approach for a serverless architecture that aims to address the issue of over-memory allocation and improve data locality. The proposed approach estimates how much memory each function uses so that similar functions can be scheduled on the same node. As a result, it makes less use of each node and keeps the state within a single node. We evaluated our approach through the existing FaaS applications and real-world data.

AB - In a serverless architecture, a function does not fully utilize the allocated memory. Such memory over-allocation increases node utilization and wastes resources, causing cold-start and latency issues. This paper presents a fine-grained scheduling approach for a serverless architecture that aims to address the issue of over-memory allocation and improve data locality. The proposed approach estimates how much memory each function uses so that similar functions can be scheduled on the same node. As a result, it makes less use of each node and keeps the state within a single node. We evaluated our approach through the existing FaaS applications and real-world data.

KW - and resource utilization

KW - scheduling

KW - Serverless computing

UR - http://www.scopus.com/inward/record.url?scp=85166736764&partnerID=8YFLogxK

U2 - 10.1109/CCGridW59191.2023.00056

DO - 10.1109/CCGridW59191.2023.00056

M3 - Conference contribution

AN - SCOPUS:85166736764

T3 - Proceedings - 23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing Workshops, CCGridW 2023

SP - 275

EP - 277

BT - Proceedings - 23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing Workshops, CCGridW 2023

A2 - Simmhan, Yogesh

A2 - Altintas, Ilkay

A2 - Varbanescu, Ana-Lucia

A2 - Balaji, Pavan

A2 - Prasad, Abhinandan S.

A2 - Carnevale, Lorenzo

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing Workshops, CCGridW 2023

Y2 - 1 May 2023 through 4 May 2023

ER -

Pandey M, Kwon YW. Optimizing Memory Allocation in a Serverless Architecture through Function Scheduling. In Simmhan Y, Altintas I, Varbanescu AL, Balaji P, Prasad AS, Carnevale L, editors, Proceedings - 23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing Workshops, CCGridW 2023. Institute of Electrical and Electronics Engineers Inc. 2023. p. 275-277. (Proceedings - 23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing Workshops, CCGridW 2023). doi: 10.1109/CCGridW59191.2023.00056

Optimizing Memory Allocation in a Serverless Architecture through Function Scheduling

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this