Token Encoding for Semantic Recovery
Not on the map. Why?
Abstract (arXiv)
In generative semantic communication, semantic tokens guide receiver-side generative models to synthesize high-dimensional content. In challenging network environments, however, frequent token erasure distorts the conveyed semantics beyond what receiver-side recovery can restore. In this paper, we propose a token encoding framework (TokCode) for robust semantic recovery, achieving erasure resilience by restructuring redundancy in the semantic domain. TokCode uses a lightweight adapter to recast a general-purpose large language model (LLM) at the transmitter into a token encoder, exploiting the LLM's pretrained semantic prior to avoid introducing a dedicated deep model. To optimize the adapter efficiently and make it applicable across diverse channels, we develop a channel-quality-aware distillation approach for token encoder training~(CADET). Using a differentiable sentence-level semantic surrogate, CADET tunes T5 foundation models into experts for distinct erasure rates and distills them into a single reconfigurable low-rank adapter, enabling subsequent reinforcement learning (RL) to start above the plateau where direct RL stalls. Simulation results on token-based generative image transmission show that TokCode improves the image-level similarity over the best-performing receiver-side recovery benchmark by 14.1%--22.4%, closing 71.9%--76.5% of its gap to the erasure-aware oracle encoding, when only 20% to 50% of the tokens survive.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 29 of its 42 references that are in the map. First posted on arXiv 14 Apr 2026.
Builds on
29 of 42 references.
References · 29
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025DINOv3cited by 1,297
- 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 462
- 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 376
- 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generationcited by 326
17 more
- 2020Deep Learning Enabled Semantic Communication Systemscited by 282
- 2019Understanding Straight-Through Estimator in Training Activation Quantized Neural Netscited by 225
- 2024MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Casescited by 216
- 2024Fast On-device LLM Inference with NPUscited by 58
- 2022Robust Semantic Communications with Masked VQ-VAE Enabled Codebookcited by 53
- 2023Generative AI-driven Semantic Communication Networks: Architecture, Technologies and Applicationscited by 36
- 20206G Wireless Systems: Vision, Requirements, Challenges, Insights, and Opportunitiescited by 35
- 2025Token Communications: A Large Model-Driven Framework for Cross-modal Context-aware Semantic Communicationscited by 32
- 2020Internet of Underwater Things and Big Marine Data Analytics -- A Comprehensive Surveycited by 11
- 2023GRACE: Loss-Resilient Real-Time Video through Neural Codecscited by 9
- 2024Generative Semantic Communication via Textual Prompts: Latency Performance Tradeoffscited by 8
- 2024Semantic Satellite Communications Based on Generative Foundation Modelcited by 6
- 2019Towards the Internet of Underground Things: A Systematic Surveycited by 3
- 2025ResiTok: A Resilient Tokenization-Enabled Framework for Ultra-Low-Rate and Robust Image Transmissioncited by 2
- 2025Distillation-Enabled Knowledge Alignment Protocol for Semantic Communication in AI Agent Networkscited by 2
- 2025Distillation-Enabled Knowledge Alignment for Generative Semantic Communications of AIGC Imagescited by 1
- 2025Error-Resilient Semantic Communication for Speech Transmission over Packet-Loss Networkscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.