Distillation-Enabled Knowledge Alignment Protocol for Semantic Communication in AI Agent Networks
Not on the map. Why?
Abstract (arXiv)
Future networks are envisioned to connect massive artificial intelligence (AI) agents, enabling their extensive collaboration on diverse tasks. Compared to traditional entities, these agents naturally suit the semantic communication (SC), which can significantly enhance the bandwidth efficiency. Nevertheless, SC requires the knowledge among agents to be aligned, while agents have distinct expert knowledge for their individual tasks in practice. In this paper, we propose a distillation-enabled knowledge alignment protocol (DeKAP), which distills the expert knowledge of each agent into parameter-efficient low-rank matrices, allocates them across the network, and allows agents to simultaneously maintain aligned knowledge for multiple tasks. We formulate the joint minimization of alignment loss, communication overhead, and storage cost as a large-scale integer linear programming problem and develop a highly efficient greedy algorithm. From computer simulation, the DeKAP establishes knowledge alignment with the lowest communication and computation resources compared to conventional approaches.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 11 of its 19 references that are in the map. First posted on arXiv 7 May 2025.
Builds on
11 of 19 references.
References · 11
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2017Neural Discrete Representation Learningcited by 4,712
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2020Deep Learning Enabled Semantic Communication Systemscited by 292
- 2023The Expressive Power of Low-Rank Adaptationcited by 102
- 2022Deep Learning-Enabled Semantic Communication Systems with Task-Unaware Transmitter and Dynamic Datacited by 36
- 2023Semantic Channel Equalizer: Modelling Language Mismatch in Multi-User Semantic Communicationscited by 15
- 2024Dynamic Relative Representations for Goal-Oriented Semantic Communicationscited by 11
- 2023Semantics Alignment via Split Learning for Resilient Multi-User Semantic Communicationcited by 3
- 2024Soft Partitioning of Latent Space for Semantic Channel Equalizationcited by 3
- 2024Zero-Forget Preservation of Semantic Communication Alignment in Distributed AI Networkscited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.