# Semantic Communication Enhanced by Knowledge Graph Representation Learning

arXiv: https://arxiv.org/abs/2407.19338 · HTML: https://mlsanity.com/paper/2407.19338/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- Builds on 17 of its 26 references that are in the map.
- First posted on arXiv 27 Jul 2024.

## Builds on (most cited first, 17 of 17)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks](https://mlsanity.com/paper/1908.10084/) (2019)
- [Strategies for Pre-training Graph Neural Networks](https://mlsanity.com/paper/1905.12265/) (2019)
- [Large Language Models on Graphs: A Comprehensive Survey](https://mlsanity.com/paper/2312.02783/) (2023)
- [Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communications](https://mlsanity.com/paper/2207.09353/) (2022)
- [6G Networks: Beyond Shannon Towards Semantic and Goal-Oriented Communications](https://mlsanity.com/paper/2011.14844/) (2020)
- [Semantics-Empowered Communication for Networked Intelligent Systems](https://mlsanity.com/paper/2007.11579/) (2020)
- [What is Semantic Communication? A View on Conveying Meaning in the Era of Machine Intelligence](https://mlsanity.com/paper/2110.00196/) (2021)
- [Enhancing Knowledge Graph Construction Using Large Language Models](https://mlsanity.com/paper/2305.04676/) (2023)
- [Goal-Oriented and Semantic Communication in 6G AI-Native Networks: The 6G-GOALS Approach](https://mlsanity.com/paper/2402.07573/) (2024)
- [Learning Semantics: An Opportunity for Effective 6G Communications](https://mlsanity.com/paper/2110.08049/) (2021)
- [Semantic Channel Equalizer: Modelling Language Mismatch in Multi-User Semantic Communications](https://mlsanity.com/paper/2308.03789/) (2023)
- [Wireless End-to-End Image Transmission System using Semantic Communications](https://mlsanity.com/paper/2302.13721/) (2023)
- [Cognitive Semantic Communication Systems Driven by Knowledge Graph](https://mlsanity.com/paper/2202.11958/) (2022)
- [Goal-oriented Communications for the IoT: System Design and Adaptive Resource Optimization](https://mlsanity.com/paper/2310.13948/) (2023)
- [Dynamic Relative Representations for Goal-Oriented Semantic Communications](https://mlsanity.com/paper/2403.16986/) (2024)
- [Cognitive Semantic Communication Systems Driven by Knowledge Graph: Principle, Implementation, and Performance Evaluation](https://mlsanity.com/paper/2303.08546/) (2023)

## Built on by (most cited first, 5 of 5)

- [Towards 6G Native-AI Edge Networks: A Semantic-Aware and Agentic Intelligence Paradigm](https://mlsanity.com/paper/2512.04405/) (2025)
- [Semantic Communication with Hopfield Memories](https://mlsanity.com/paper/2511.10302/) (2025)
- [Semantic Waveforms for AI-Native 6G Networks](https://mlsanity.com/paper/2602.13316/) (2026)
- [AeroLat: Channel-Aware Latent Space Semantic Communication for Decentralized UAV Swarms](https://mlsanity.com/paper/2609.16947/) (2026)
- [End-to-End Quantum Semantic Communication with Variational Quantum Neural Networks](https://mlsanity.com/paper/2609.25044/) (2026)

## Abstract (arXiv)

This paper investigates the advantages of representing and processing semantic knowledge extracted into graphs within the emerging paradigm of semantic communications. The proposed approach leverages semantic and pragmatic aspects, incorporating recent advances on large language models (LLMs) to achieve compact representations of knowledge to be processed and exchanged between intelligent agents. This is accomplished by using the cascade of LLMs and graph neural networks (GNNs) as semantic encoders, where information to be shared is selected to be meaningful at the receiver. The embedding vectors produced by the proposed semantic encoder represent information in the form of triplets: nodes (semantic concepts entities), edges(relations between concepts), nodes. Thus, semantic information is associated with the representation of relationships among elements in the space of semantic concept abstractions. In this paper, we investigate the potential of achieving high compression rates in communication by incorporating relations that link elements within graph embeddings. We propose sending semantic symbols solely equivalent to node embeddings through the wireless channel and inferring the complete knowledge graph at the receiver. Numerical simulations illustrate the effectiveness of leveraging knowledge graphs to semantically compress and transmit information.
