An Edge-Cloud Collaboration Framework for Generative AI Service Provision with Synergetic Big Cloud Model and Small Edge Models
Not on the map. Why?
Abstract (arXiv)
Generative artificial intelligence (GenAI) offers various services to users through content creation, which is believed to be one of the most important components in future networks. However, training and deploying big artificial intelligence models (BAIMs) introduces substantial computational and communication overhead.This poses a critical challenge to centralized approaches, due to the need of high-performance computing infrastructure and the reliability, secrecy and timeliness issues in long-distance access of cloud services. Therefore, there is an urging need to decentralize the services, partly moving them from the cloud to the edge and establishing native GenAI services to enable private, timely, and personalized experiences. In this paper, we propose a brand-new bottom-up BAIM architecture with synergetic big cloud model and small edge models, and design a distributed training framework and a task-oriented deployment scheme for efficient provision of native GenAI services. The proposed framework can facilitate collaborative intelligence, enhance adaptability, gather edge knowledge and alleviate edge-cloud burden. The effectiveness of the proposed framework is demonstrated through an image generation use case. Finally, we outline fundamental research directions to fully exploit the collaborative potential of edge and cloud for native GenAI and BAIM applications.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Jan 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 5; 2025: 3; 2026: 1.
9 papers.
- 2024Mobile Edge Intelligence for Large Language Models: A Contemporary Surveycited by 125
- 2025A Survey of Personalized Large Language Models: Progress and Future Directionscited by 65
- 2024WDMoE: Wireless Distributed Large Language Models with Mixture of Expertscited by 18
- 2024WDMoE: Wireless Distributed Mixture of Experts for Large Language Modelscited by 12
- 2024Hybrid SD: Edge-Cloud Collaborative Inference for Stable Diffusion Modelscited by 11
- 2025A Survey of Foundation Models for IoT: Taxonomy and Criteria-Based Analysiscited by 5
- 2026PipeSD: An Efficient Cloud-Edge Collaborative Pipeline Inference Framework with Speculative Decodingcited by 4
- 2025Distillation-Enabled Knowledge Alignment for Generative Semantic Communications of AIGC Imagescited by 1
- 2024Disentangling data distribution for Federated Learningcited by 0
- 2026PipeSD: An Efficient Cloud-Edge Collaborative Pipeline Inference Framework with Speculative Decoding13 May 2026
- 2025Distillation-Enabled Knowledge Alignment for Generative Semantic Communications of AIGC Images24 Jun 2025
- 2025A Survey of Foundation Models for IoT: Taxonomy and Criteria-Based Analysis13 Jun 2025
- 2025A Survey of Personalized Large Language Models: Progress and Future Directions17 Feb 2025
- 2024WDMoE: Wireless Distributed Mixture of Experts for Large Language Models11 Nov 2024
- 2024Disentangling data distribution for Federated Learning16 Oct 2024
- 2024Hybrid SD: Edge-Cloud Collaborative Inference for Stable Diffusion Models13 Aug 2024
- 2024Mobile Edge Intelligence for Large Language Models: A Contemporary Survey9 Jul 2024
- 2024WDMoE: Wireless Distributed Large Language Models with Mixture of Experts6 May 2024