Towards Integrated Fine-tuning and Inference when Generative AI meets Edge Intelligence
Not on the map. Why?
Abstract (arXiv)
The high-performance generative artificial intelligence (GAI) represents the latest evolution of computational intelligence, while the blessing of future 6G networks also makes edge intelligence (EI) full of development potential. The inevitable encounter between GAI and EI can unleash new opportunities, where GAI's pre-training based on massive computing resources and large-scale unlabeled corpora can provide strong foundational knowledge for EI, while EI can harness fragmented computing resources to aggregate personalized knowledge for GAI. However, the natural contradictory features pose significant challenges to direct knowledge sharing. To address this, in this paper, we propose the GAI-oriented synthetical network (GaisNet), a collaborative cloud-edge-end intelligence framework that buffers contradiction leveraging data-free knowledge relay, where the bidirectional knowledge flow enables GAI's virtuous-cycle model fine-tuning and task inference, achieving mutualism between GAI and EI with seamless fusion and collaborative evolution. Experimental results demonstrate the effectiveness of the proposed mechanisms. Finally, we discuss the future challenges and directions in the interplay between GAI and EI.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 23 references that are in the map. First posted on arXiv 5 Jan 2024.
Builds on
14 of 23 references.
References · 14
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022Visual Prompt Tuningcited by 1,674
- 2021Towards a Unified View of Parameter-Efficient Transfer Learningcited by 863
- 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTcited by 221
- 2023When Foundation Model Meets Federated Learning: Motivations, Challenges, and Future Directionscited by 83
- 2018JointDNN: An Efficient Training and Inference Engine for Intelligent Mobile Cloud Computing Servicescited by 79
- 2023Split Learning in 6G Edge Networkscited by 68
- 2022FedTune: A Deep Dive into Efficient Federated Fine-Tuning with Pre-trained Transformerscited by 33
- 2023Federated Learning-Empowered AI-Generated Content in Wireless Networkscited by 26
- 2023Wireless Multi-Agent Generative AI: From Connected Intelligence to Collective Intelligencecited by 25
Built on by
Not cited yet.