# TrimCaching: Parameter-sharing AI Model Caching in Wireless Edge Networks

arXiv: https://arxiv.org/abs/2405.03990 · HTML: https://mlsanity.com/paper/2405.03990/

## Key facts

- Cited by 12 papers in the map (data through 14 Oct 2026).
- Builds on 23 of its 42 references that are in the map.
- First posted on arXiv 7 May 2024.

## Builds on (most cited first, 23 of 23)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [LoRA: Low-Rank Adaptation of Large Language Models](https://mlsanity.com/paper/2106.09685/) (2021)
- [A Comprehensive Survey on Transfer Learning](https://mlsanity.com/paper/1911.02685/) (2019)
- [Federated Learning for Smart Healthcare: A Survey](https://mlsanity.com/paper/2111.08834/) (2021)
- [SpotTune: Transfer Learning through Adaptive Fine-tuning](https://mlsanity.com/paper/1811.08737/) (2018)
- [Efficient Parallel Split Learning over Resource-constrained Wireless Edge Networks](https://mlsanity.com/paper/2303.15991/) (2023)
- [Pushing Large Language Models to the 6G Edge: Vision, Challenges, and Opportunities](https://mlsanity.com/paper/2309.16739/) (2023)
- [Split Learning in 6G Edge Networks](https://mlsanity.com/paper/2306.12194/) (2023)
- [FedHome: Cloud-Edge based Personalized Federated Learning for In-Home Health Monitoring](https://mlsanity.com/paper/2012.07450/) (2020)
- [Submodular Optimization with Submodular Cover and Submodular Knapsack Constraints](https://mlsanity.com/paper/1311.2106/) (2013)
- [Optimal Resource Allocation for U-Shaped Parallel Split Learning](https://mlsanity.com/paper/2308.08896/) (2023)
- [GEMEL: Model Merging for Memory-Efficient, Real-Time Video Analytics at the Edge](https://mlsanity.com/paper/2201.07705/) (2022)
- [Vehicle as a Service (VaaS): Leverage Vehicles to Build Service Networks and Capabilities for Smart Cities](https://mlsanity.com/paper/2304.11397/) (2023)
- [Cached Model-as-a-Resource: Provisioning Large Language Model Agents for Edge Intelligence in Space-air-ground Integrated Networks](https://mlsanity.com/paper/2403.05826/) (2024)
- [TrimCaching: Parameter-sharing Edge Caching for AI Model Downloading](https://mlsanity.com/paper/2404.14204/) (2024)
- [Big Data Caching for Networking: Moving from Cloud to Edge](https://mlsanity.com/paper/1606.01581/) (2016)
- [Fast Semidifferential-based Submodular Function Optimization](https://mlsanity.com/paper/1308.1006/) (2013)
- [Caching at the Wireless Edge: Design Aspects, Challenges and Future Directions](https://mlsanity.com/paper/1810.13287/) (2018)
- [QoS-Aware Placement of Deep Learning Services on the Edge with Multiple Service Implementations](https://mlsanity.com/paper/2104.15094/) (2021)
- [Cooperative Edge Caching in User-Centric Clustered Mobile Networks](https://mlsanity.com/paper/1710.08582/) (2017)
- [In-situ Model Downloading to Realize Versatile Edge AI in 6G Mobile Networks](https://mlsanity.com/paper/2210.03555/) (2022)
- [Efficient Multiuser AI Downloading via Reusable Knowledge Broadcasting](https://mlsanity.com/paper/2307.15316/) (2023)
- [Ultra-Dense 5G Small Cell Deployment for Fiber and Wireless Backhaul-Aware Infrastructures](https://mlsanity.com/paper/1808.01297/) (2018)

## Built on by (most cited first, 12 of 12)

- [Mobile Edge Intelligence for Large Language Models: A Contemporary Survey](https://mlsanity.com/paper/2407.18921/) (2024)
- [SplitLoRA: A Split Parameter-Efficient Fine-Tuning Framework for Large Language Models](https://mlsanity.com/paper/2407.00952/) (2024)
- [Large Model Based Agents: State-of-the-Art, Cooperation Paradigms, Security and Privacy, and Future Trends](https://mlsanity.com/paper/2409.14457/) (2024)
- [AgentsCoMerge: Large Language Model Empowered Collaborative Decision Making for Ramp Merging](https://mlsanity.com/paper/2408.03624/) (2024)
- [CP-Guard: Malicious Agent Detection and Defense in Collaborative Bird's Eye View Perception](https://mlsanity.com/paper/2412.12000/) (2024)
- [SlimCaching: Edge Caching of Mixture-of-Experts for Distributed Inference](https://mlsanity.com/paper/2507.06567/) (2025)
- [An Efficient Privacy-aware Split Learning Framework for Satellite Communications](https://mlsanity.com/paper/2409.08538/) (2024)
- [PartialLoading: User Scheduling and Bandwidth Allocation for Parameter-sharing Edge Inference](https://mlsanity.com/paper/2503.22982/) (2025)
- [Privacy-Aware Joint DNN Model Deployment and Partitioning Optimization for Collaborative Edge Inference Services](https://mlsanity.com/paper/2502.16091/) (2025)
- [Task-Aware Parameter-Efficient Fine-Tuning of Large Pre-Trained Models at the Edge](https://mlsanity.com/paper/2504.03718/) (2025)
- [Fine-Grained AI Model Caching and Downloading With Coordinated Multipoint Broadcasting in Multi-Cell Edge Networks](https://mlsanity.com/paper/2509.19341/) (2025)
- [AIR-LLM: Broadcasting AI Weights over Radio for Memory-Free Edge LLM Inference via RF Computing](https://mlsanity.com/paper/2610.00465/) (2026)

## Abstract (arXiv)

Next-generation mobile networks are expected to facilitate fast AI model downloading to end users. By caching models on edge servers, mobile networks can deliver models to end users with low latency, resulting in a paradigm called edge model caching. In this paper, we develop a novel model placement scheme, called parameter-sharing model caching (TrimCaching). TrimCaching exploits the key observation that a wide range of AI models, such as convolutional neural networks or large language models, can share a significant proportion of parameter blocks containing reusable knowledge, thereby improving storage efficiency. To this end, we formulate a parameter-sharing model placement problem to maximize the cache hit ratio in multi-edge wireless networks by balancing the fundamental tradeoff between storage efficiency and service latency. We show that the formulated problem is a submodular maximization problem with submodular constraints, for which no polynomial-time approximation algorithm exists. To overcome this challenge, we study an important special case, where a small fixed number of parameter blocks are shared across models, which often holds in practice. In such a case, a polynomial-time algorithm with left(1-εright)/2-approximation guarantee is developed. Subsequently, we address the original problem for the general case by developing a greedy algorithm. Simulation results demonstrate that the proposed TrimCaching framework significantly improves the cache hit ratio compared with state-of-the-art content caching without exploiting shared parameters in AI models.
