From Semantic to Token Communication: The Next Paradigm for Large-Model-Driven 6G Intelligent Connectivity
Not on the map. Why?
Abstract (arXiv)
The ambitious requirements of sixth-generation (6G) networks are driving communication systems from reliable bit delivery toward meaning-aware and task-oriented connectivity. Large models (LMs), with strong multimodal understanding and generation capabilities, have accelerated this shift and made semantic communication (SemCom) increasingly practical. Yet current LM-driven SemCom remains fragmented: semantic representations are typically tied to specific modalities, models, or tasks. While the bit provides a universal unit for digital transport, there is still no analogous unit for representing and processing semantics, which limits interoperability, theoretical unification, and scalable system design. We argue that tokens provide a natural candidate for this missing abstraction. Two trends support this: unified multimodal LMs now encode text, images, audio, video, and robot actions in one token space, while distributed LM inference already generates substantial token-level traffic through expert routing, cache transfer, and speculative decoding. Token communication (TokenCom) emerges by unifying these trends, using the LM's native processing unit as a communication abstraction above the bit level and enabling importance assignment, error handling, and resource allocation directly at token granularity. This survey traces the evolution from LM-driven SemCom to TokenCom. We review three major directions of LM-driven SemCom: source-centric semantic coding, channel semantics for physical-layer tasks, and collaborative edge-device intelligence. We then examine the token abstraction, the transmission techniques it requires, and two emerging paradigms, namely TokenCom for LM services and for embodied and agentic intelligence. Finally, we identify open challenges toward unified, scalable, and AI-native 6G communication systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 132 of its 169 references that are in the map. First posted on arXiv 9 Sep 2026.
Builds on
132 of 169 references.
References · 132
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2023Visual Instruction Tuningcited by 7,869
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2022Scalable Diffusion Models with Transformerscited by 6,054
38 more
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2017Neural Discrete Representation Learningcited by 4,712
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2022Emergent Abilities of Large Language Modelscited by 2,512
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,989
- 2022MaskGIT: Masked Generative Image Transformercited by 1,099
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
- 2022Autoregressive Image Generation using Residual Quantizationcited by 722
- 2024DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Servingcited by 617
- 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 590
- 2024An Image is Worth 32 Tokens for Reconstruction and Generationcited by 302
- 2020Deep Learning Enabled Semantic Communication Systemscited by 292
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 279
- 2019Rethinking Lossy Compression: The Rate-Distortion-Perception Tradeoffcited by 211
- 2024Mobile Edge Intelligence for Large Language Models: A Contemporary Surveycited by 128
- 20206G Networks: Beyond Shannon Towards Semantic and Goal-Oriented Communicationscited by 112
- 2021Semantic Communication Systems for Speech Transmissioncited by 97
- 2019DeepJSCC-f: Deep Joint Source-Channel Coding of Images with Feedbackcited by 96
- 2025Cache-to-Cache: Direct Semantic Communication Between Large Language Modelscited by 61
- 2022Robust Semantic Communications with Masked VQ-VAE Enabled Codebookcited by 56
- 2021Multimodal Image Synthesis and Editing: The Generative AI Eracited by 52
- 2021Task-Oriented Multi-User Semantic Communications for VQA Taskcited by 51
- 2022Wireless Semantic Communications for Video Conferencingcited by 50
- 2025One-D-Piece: Image Tokenizer Meets Quality-Controllable Compressioncited by 48
- 2021Semantic Distance: A New Metric for ASR Performance Analysis Towards Spoken Language Understandingcited by 42
- 2024Large Wireless Model (LWM): A Foundation Model for Wireless Channelscited by 40
- 2025KVCOMM: Online Cross-context KV-cache Communication for Efficient LLM-based Multi-agent Systemscited by 40
- 2022DeepJSCC-Q: Constellation Constrained Deep Joint Source-Channel Codingcited by 38
- 2023Generative AI-driven Semantic Communication Networks: Architecture, Technologies and Applicationscited by 36
- 2023Large AI Model-Based Semantic Communicationscited by 35
- 2025Token Communications: A Large Model-Driven Framework for Cross-modal Context-aware Semantic Communicationscited by 35
- 2022Deep Learning Enabled Semantic Communications with Speech Recognition and Synthesiscited by 33
- 2025MegaScale-MoE: Large-Scale Communication-Efficient Training of Mixture-of-Experts Models in Productioncited by 31
50 most cited of 132 All 132 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Closing the Semantic-Edge Gap: Tiny Language Models for 6G Wireless Intelligence ↗
- 2023Pushing Large Language Models to the 6G Edge: Vision, Challenges, and Opportunities
- 2026ComVLA: Communication-Aware Split Inference for VLA Models in 6G-Connected Robotics
- 2026How Small Can 6G Reason? Scaling Tiny-to-Small Language Models for AI-Native Networks
- 2025Towards 6G Native-AI Edge Networks: A Semantic-Aware and Agentic Intelligence Paradigm
- 2024When Large Language Model Agents Meet 6G Networks: Perception, Grounding, and Alignment
- 2025Agentic AI-Enhanced Semantic Communications: Foundations, Architecture, and Applications ↗
- 2025Semantic Communication meets System 2 ML: How Abstraction, Compositionality and Emergent Languages Shape Intelligence