mlsanityData to 14 Oct 2026

Token Communications: A Large Model-Driven Framework for Cross-modal Context-aware Semantic Communications

arXiv 2502.12096 ↗First posted 17 Feb 2025cs.MM cs.CV cs.ITcited by 35

Not on the map. Why?

Abstract (arXiv)

In this paper, we introduce token communications (TokCom), a large model-driven framework to leverage cross-modal context information in generative semantic communications (GenSC). TokCom is a new paradigm, motivated by the recent success of generative foundation models and multimodal large language models (GFM/MLLMs), where the communication units are tokens, enabling efficient transformer-based token processing at the transmitter and receiver. In this paper, we introduce the potential opportunities and challenges of leveraging context in GenSC, explore how to integrate GFM/MLLMs-based token processing into semantic communication systems to leverage cross-modal context effectively at affordable complexity, present the key principles for efficient TokCom at various layers in future wireless networks. In a typical image semantic communication setup, we demonstrate a significant improvement of the bandwidth efficiency, achieved by TokCom by leveraging the context information among tokens. Finally, the potential research directions are identified to facilitate adoption of TokCom in future wireless networks.

Key facts. Cited by 35 papers in the map (data through 14 Oct 2026). Builds on 14 of its 18 references that are in the map. First posted on arXiv 17 Feb 2025.

Builds on

14 of 18 references.

References · 14

  1. 2020Scaling Laws for Neural Language Modelscited by 6,586
  2. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  3. 2022MaskGIT: Masked Generative Image Transformercited by 1,099
  4. 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 590
  5. 2024An Image is Worth 32 Tokens for Reconstruction and Generationcited by 302
  6. 2023Language Modeling Is Compressioncited by 225
  7. 2019Rethinking Lossy Compression: The Rate-Distortion-Perception Tradeoffcited by 211
  8. 2022Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communicationscited by 175
  9. 2022Semantic Communications for Future Internet: Fundamentals, Applications, and Challengescited by 95
  10. 2023Generative AI-driven Semantic Communication Networks: Architecture, Technologies and Applicationscited by 36
  11. 2024Latency-Aware Generative Semantic Communications with Pre-Trained Diffusion Modelscited by 25
  12. 2024Uncertainty-Aware Hybrid Inference with On-Device Small and Remote Large Language Modelscited by 19
2 more
  1. 2024Generative Semantic Communication via Textual Prompts: Latency Performance Tradeoffscited by 8
  2. 2024S-RAN: Semantic-Aware Radio Access Networkscited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 14; 2026: 21.

35 papers.

Sort:

By area:

  1. 2025Adaptive Semantic Token Communication for Transformer-based Edge Inferencecited by 14
  2. 2025Token Communication in the Era of Large Models: An Information Bottleneck-Based Approachcited by 11
  3. 2025ToDMA: Large Model-Driven Massive Token Communications for Semantic Multiple Accesscited by 7
  4. 2025Adaptive Token Merging for Efficient Transformer Semantic Communication at the Edgecited by 7
  5. 2025Joint Semantic-Channel Coding and Modulation for Token Communicationscited by 7
  6. 2025Low-Complexity Semantic Packet Aggregation for Token Communication via Lookahead Searchcited by 5
  7. 2026Video TokenCom: Textual Intent-Guided Multi-Rate Video Token Communications with UEP-Based Adaptive Source-Channel Codingcited by 5
  8. 2025Task-Oriented Multimodal Token Transmission in Resource-Constrained Multiuser Networkscited by 3
  9. 2025Revisiting MLLM Token Technology through the Lens of Classical Visual Codingcited by 3
  10. 2026TokenCom: Vision-Language Model for Multimodal and Multitask Token Communicationscited by 3
  11. 2025Federated Learning-Enabled Hybrid Language Models for Communication-Efficient Token Transmissioncited by 2
  12. 2025Adaptive Pareto-Optimal Token Merging for Edge Transformer Models in Semantic Communicationcited by 2
23 more
  1. 2026Compression Tells Intelligence: Visual Coding, Visual Token Technology, and the Unificationcited by 2
  2. 2026Wireless TokenCom: RL-Based Tokenizer Agreement for Multi-User Wireless Token Communicationscited by 2
  3. 2026Token Encoding for Semantic Recoverycited by 1
  4. 2026Progressive Semantic Communication for Efficient Edge-Cloud Vision-Language Modelscited by 1
  5. 2026Context-Aware Wireless Token Communication via Joint Token Masking and Detectioncited by 1
  6. 2026Ada-TokenCom: Rate-Adaptive Token Communications via Large-Model-Driven Token Compression and Generationcited by 1
  7. 2025Task-Adaptive Semantic Communications with Controllable Diffusion-based Data Regenerationcited by 0
  8. 2025TACO: Rethinking Semantic Communications with Task Adaptation and Context Embeddingcited by 0
  9. 2025DiSC-Med: Diffusion-based Semantic Communications for Robust Medical Image Transmissioncited by 0
  10. 2025Goal-Oriented Multi-Agent Semantic Networking: Unifying Intents, Semantics, and Intelligencecited by 0
  11. 2026MD-AirComp+: Adaptive Quantization for Blind Massive Digital Over-the-Air Computationcited by 0
  12. 2026Evolving Token Communication with Parametric Memory Networkcited by 0
  13. 2026Explainable Task-Oriented Token Communication for AI-Native 6G Networkscited by 0
  14. 2026Loss-Resilient Wireless Video Token Communication over Block Fading Channelscited by 0
  15. 2026ImpactHO: Importance-Aware KV Cache Transfer for Multi-User Edge LLM Handovercited by 0
  16. 2026Token-Oriented Semantic Communication with Pretrained Vision Transformerscited by 0
  17. 2026From Semantic to Token Communication: The Next Paradigm for Large-Model-Driven 6G Intelligent Connectivitycited by 0
  18. 2026SpaceDiffusion: Over-the-Orbit Diffusion for Space Generate-and-Forward Communicationscited by 0
  19. 2026SARA: SLO-Aware Resource Allocation for Disaggregated Agentic LLM Servicescited by 0
  20. 2026Semantic-Aware Joint Source-Channel Optimization for Encoder-Agnostic Digital Video Communicationcited by 0
  21. 2026Token Communication-Assisted Collaborative Embodied Artificial Intelligence: Concepts, Framework, and Opportunitiescited by 0
  22. 2026Beyond Token Accuracy: Prioritizing What Matters for Visual Reconstructioncited by 0
  23. 2026Queue-Aware Token Communications: Bridging AI Representation and Wireless Servicecited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Training-Free Multi-User Generative Semantic Communications via Null-Space Diffusion Sampling
  2. 2023Language-Oriented Communication with Semantic Coding and Knowledge Distillation for Text-to-Image Generation
  3. 2024Language-oriented Semantic Communication for Image Transmission with Fine-Tuned Diffusion Model
  4. 2024Semantic Successive Refinement: A Generative AI-aided Semantic Communication Framework
  5. 2023Large AI Model Empowered Multimodal Semantic Communications
  6. 2024Semantic-Aware Power Allocation for Generative Semantic Communications with Foundation Models
  7. 2024Communicate Less, Synthesize the Rest: Latency-aware Intent-based Generative Semantic Multicasting with Diffusion Models
  8. 2025Latent Feature-Guided Conditional Diffusion for Generative Image Semantic Communication ↗