mlsanityData to 7 Oct 2026

Semantics-Native Communication with Contextual Reasoning

arXiv 2108.05681 ↗First posted 12 Aug 2021cs.IT cs.LG math.ITcited by 21

Not on the map. Why?

Abstract (arXiv)

Spurred by a huge interest in the post-Shannon communication, it has recently been shown that leveraging semantics can significantly improve the communication effectiveness across many tasks. In this article, inspired by human communication, we propose a novel stochastic model of System 1 semantics-native communication (SNC) for generic tasks, where a speaker has an intention of referring to an entity, extracts the semantics, and communicates its symbolic representation to a target listener. To further reach its full potential, we additionally infuse contextual reasoning into SNC such that the speaker locally and iteratively self-communicates with a virtual agent built on the physical listener's unique way of coding its semantics, i.e., communication context. The resultant System 2 SNC allows the speaker to extract the most effective semantics for its listener. Leveraging the proposed stochastic model, we show that the reliability of System 2 SNC increases with the number of meaningful concepts, and derive the expected semantic representation (SR) bit length which quantifies the extracted effective semantics. It is also shown that System 2 SNC significantly reduces the SR length without compromising communication reliability.

Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 20 of its 44 references that are in the map. First posted on arXiv 12 Aug 2021.

Builds on

20 of 44 references.

References · 20

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  2. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
  3. 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,519
  4. 2016Learning to Communicate with Deep Multi-Agent Reinforcement Learningcited by 561
  5. 2020Deep Learning Enabled Semantic Communication Systemscited by 282
  6. 2020Inductive Biases for Deep Learning of Higher-Level Cognitioncited by 273
  7. 2016Multi-Agent Cooperation and the Emergence of (Natural) Languagecited by 181
  8. 2020Emergent Multi-Agent Communication in the Deep Learning Eracited by 168
  9. 20206G Networks: Beyond Shannon Towards Semantic and Goal-Oriented Communicationscited by 108
  10. 2019Learning to Schedule Communication in Multi-agent Reinforcement Learningcited by 89
  11. 2020A Lite Distributed Semantic Communication System for Internet of Thingscited by 69
  12. 2020Semantics-Empowered Communication for Networked Intelligent Systemscited by 60
8 more
  1. 2020Federated Knowledge Distillationcited by 51
  2. 2019A mathematical theory of cooperative communicationcited by 23
  3. 2019Semantic-Effectiveness Filtering and Control for Post-5G Wireless Connectivitycited by 20
  4. 2020A Rate-Distortion view of human pragmatic reasoningcited by 19
  5. 2021A new communication paradigm: from bit accuracy to semantic fidelitycited by 18
  6. 2020Incorporating Pragmatic Reasoning Communication into Emergent Languagecited by 15
  7. 2021Attention-based Reinforcement Learning for Real-Time UAV Semantic Communicationcited by 13
  8. 2021Split Learning Meets Koopman Theory for Wireless Remote Monitoring and Predictioncited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 3; 2022: 6; 2023: 6; 2024: 3; 2025: 0; 2026: 3.

21 papers.

Sort:

By area:

  1. 2021Semantic Communications: Principles and Challengescited by 90
  2. 2023Language-Oriented Communication with Semantic Coding and Knowledge Distillation for Text-to-Image Generationcited by 17
  3. 2021Reinforcement Learning-powered Semantic Communication via Semantic Similaritycited by 15
  4. 2022Curriculum Learning for Goal-Oriented Semantic Communications with a Common Languagecited by 13
  5. 2022Cognitive Semantic Communication Systems Driven by Knowledge Graphcited by 12
  6. 2021Common Language for Goal-Oriented Semantic Communications: A Curriculum Learning Frameworkcited by 11
  7. 2022Neuro-Symbolic Artificial Intelligence (AI) for Intent based Semantic Communicationcited by 10
  8. 2022An Indirect Rate-Distortion Characterization for Semantic Sources: General Model and the Case of Gaussian Observationcited by 8
  9. 2022Enabling the Wireless Metaverse via Semantic Multiverse Communicationcited by 6
  10. 2023How to Evaluate Semantic Communications for Images with ViTScore Metric?cited by 6
  11. 2024Time-Series JEPA for Predictive Remote Control under Capacity-Limited Networkscited by 5
  12. 2023Bayesian Inverse Contextual Reasoning for Heterogeneous Semantics-Native Communicationcited by 3
9 more
  1. 2023Semantics Alignment via Split Learning for Resilient Multi-User Semantic Communicationcited by 3
  2. 2022Semantic-Native Communication: A Simplicial Complex Perspectivecited by 1
  3. 2024Dynamic and Super-Personalized Media Ecosystem Driven by Generative AI: Unpredictable Plays Never Repeating The Samecited by 1
  4. 2026Reasoning-Native Agentic Communication for 6Gcited by 1
  5. 2023CSM-H-R: A Context Modeling Framework in Supporting Reasoning Automation for Interoperable Intelligent Systems and Privacy Protectioncited by 0
  6. 2023Joint Semantic-Native Communication and Inference via Minimal Simplicial Structurescited by 0
  7. 2024Semantic Communication and Control Co-Design for Multi-Objective Distinct Dynamicscited by 0
  8. 2026Logic-Driven Semantic Communication for Resilient Multi-Agent Systemscited by 0
  9. 2026Embodied Semantic Communication for Collective Autonomous Agents: A Tutorial on Representation, Wireless Delivery, and Closed-Loop Coordinationcited by 0