Green or Fast? Learning to Balance Cold Starts and Idle Carbon in Serverless Computing
Not on the map. Why?
Abstract (arXiv)
Serverless computing simplifies cloud deployment but introduces new challenges in managing service latency and carbon emissions. Reducing cold-start latency requires retaining warm function instances, while minimizing carbon emissions favors reclaiming idle resources. This balance is further complicated by time-varying grid carbon intensity and varying workload patterns, under which static keep-alive policies are inefficient. We present LACE-RL, a latency-aware and carbon-efficient management framework that formulates serverless pod retention as a sequential decision problem. LACE-RL uses deep reinforcement learning to dynamically tune keep-alive durations, jointly modeling cold-start probability, function-specific latency costs, and real-time carbon intensity. Using the Huawei Public Cloud Trace, we show that LACE-RL reduces cold starts by 51.69% and idle keep-alive carbon emissions by 77.08% compared to Huawei's static policy, while achieving better latency-carbon trade-offs than state-of-the-art heuristic and single-objective baselines, approaching Oracle performance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 48 references that are in the map. First posted on arXiv 27 Feb 2026.
Builds on
12 of 48 references.
References · 12
- 2020Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud Providercited by 65
- 2022On the Role of Discount Factor in Offline Reinforcement Learningcited by 16
- 2023CarbonScaler: Leveraging Cloud Workload Elasticity for Optimizing Carbon-Efficiencycited by 16
- 2023Clover: Toward Sustainable AI with Carbon-Aware Machine Learning Inference Servicecited by 16
- 2019Serverless Computing: A Survey of Opportunities, Challenges and Applicationscited by 11
- 2024Serverless Cold Starts and Where to Find Themcited by 5
- 2022FaaSLight: General Application-Level Cold-Start Latency Optimization for Function-as-a-Service in Serverless Computingcited by 4
- 2024CASA: A Framework for SLO and Carbon-Aware Autoscaling and Scheduling in Serverless Cloud Computingcited by 3
- 2024EcoLife: Carbon-Aware Serverless Function Scheduling for Sustainable Computingcited by 3
- 2024SPES: Towards Optimizing Performance-Resource Trade-Off for Serverless Functionscited by 1
- 2024Dirigent: Lightweight Serverless Orchestrationcited by 1
- 2024Prediction-driven resource provisioning for serverless container runtimescited by 1
Built on by
Not cited yet.