CE-LSLM: Efficient Large-Small Language Model Inference and Communication via Cloud-Edge Collaboration
Not on the map. Why?
Abstract (arXiv)
Emerging intelligent service scenarios in 6G communication impose stringent requirements for low latency, high reliability, and privacy preservation. Generative large language models (LLMs) are gradually becoming key enablers for the integration of semantic communication and computation. However, due to the limited computational resources of edge devices and the increasing complexity of heterogeneous terminal access, existing centralized inference approaches fail to meet the dual demands of response efficiency and data privacy in edge-side inference tasks. To address these challenges, this paper proposes a novel collaborative inference architecture that integrates cloud-based LLMs with edge-deployed small language models (SLMs), enabling dynamic scheduling and sharing of semantic-level intermediate states, and establishing a unified computation-communication paradigm tailored for 6G networks. Specifically, a key-value (KV) cache reuse mechanism is introduced to enhance the semantic understanding of edge models through contextual guidance from the cloud, while significantly reducing edge-side computational and storage overhead. Furthermore, a cross-node parallel scheduling mechanism is proposed to achieve asynchronous coordination between model state loading and decoding computation, thereby improving edge responsiveness. In addition, we investigate layer alignment and representation compression strategies between heterogeneous models to alleviate the communication burden on the edge. Experimental results demonstrate that the proposed architecture exhibits superior adaptability and scalability in terms of inference latency, system stability, and concurrent processing capacity.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 May 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026ConsRoute:Consistency-Aware Adaptive Query Routing for Cloud-Edge-Device Large Language Modelscited by 1
- 2026Federated Reasoning Distillation Framework with Model Learnability-Aware Data Allocationcited by 0
- 2026Empowering Edge Agents: A Systematic Analysis of Edge-Cloud Collaboration in LLM Agent Executioncited by 0
- 2026Empowering Edge Agents: A Systematic Analysis of Edge-Cloud Collaboration in LLM Agent Execution13 Oct 2026
- 2026ConsRoute:Consistency-Aware Adaptive Query Routing for Cloud-Edge-Device Large Language Models22 Mar 2026
- 2026Federated Reasoning Distillation Framework with Model Learnability-Aware Data Allocation21 Feb 2026