mlsanityData to 7 Oct 2026

Deep Learning-Empowered Semantic Communication Systems with a Shared Knowledge Base

arXiv 2311.02884 ↗First posted 6 Nov 2023cs.AI cs.IT cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Deep learning-empowered semantic communication is regarded as a promising candidate for future 6G networks. Although existing semantic communication systems have achieved superior performance compared to traditional methods, the end-to-end architecture adopted by most semantic communication systems is regarded as a black box, leading to the lack of explainability. To tackle this issue, in this paper, a novel semantic communication system with a shared knowledge base is proposed for text transmissions. Specifically, a textual knowledge base constructed by inherently readable sentences is introduced into our system. With the aid of the shared knowledge base, the proposed system integrates the message and corresponding knowledge from the shared knowledge base to obtain the residual information, which enables the system to transmit fewer symbols without semantic performance degradation. In order to make the proposed system more reliable, the semantic self-information and the source entropy are mathematically defined based on the knowledge base. Furthermore, the knowledge base construction algorithm is developed based on a similarity-comparison method, in which a pre-configured threshold can be leveraged to control the size of the knowledge base. Moreover, the simulation results have demonstrated that the proposed approach outperforms existing baseline methods in terms of transmitted data size and sentence similarity.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 22 of its 50 references that are in the map. First posted on arXiv 6 Nov 2023.

Builds on

22 of 50 references.

References · 22

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2016Layer Normalizationcited by 5,579
  4. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  5. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  6. 2020Deep Learning Enabled Semantic Communication Systemscited by 282
  7. 2017An Introduction to Deep Learning for the Physical Layercited by 227
  8. 20206G Networks: Beyond Shannon Towards Semantic and Goal-Oriented Communicationscited by 108
  9. 2021Semantic Communication Systems for Speech Transmissioncited by 93
  10. 2021Semantic Communications: Principles and Challengescited by 90
  11. 2021Task-Oriented Multi-User Semantic Communicationscited by 72
  12. 2020A Lite Distributed Semantic Communication System for Internet of Thingscited by 69
10 more
  1. 2018Deep Learning for Joint Source-Channel Coding of Textcited by 68
  2. 2020From Semantic Communication to Semantic-aware Networking: Model, Architecture, and Open Problemscited by 51
  3. 2021What is Semantic Communication? A View on Conveying Meaning in the Era of Machine Intelligencecited by 48
  4. 2021Deep Source-Channel Coding for Sentence Semantic Transmission with HARQcited by 29
  5. 2021Task-Oriented Image Transmission for Scene Classification in Unmanned Aerial Systemscited by 29
  6. 2022Semantic-preserved Communication System for Highly Efficient Speech Transmissioncited by 28
  7. 2022Performance Optimization for Semantic Communications: An Attention-based Reinforcement Learning Approachcited by 28
  8. 2022Engineering Semantic Communication: A Surveycited by 11
  9. 2022One-to-Many Semantic Communication Systems: Design, Implementation, Performance Evaluationcited by 7
  10. 2020Vision, Requirements, and Technology Trend of 6G: How to Tackle the Challenges of System Coverage, Capacity,User Data-Rate and Movement Speedcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 1.

4 papers.