Robust Transmission of Punctured Text with Large Language Model-based Recovery
Not on the map. Why?
Abstract (arXiv)
With the recent advancements in deep learning, semantic communication which transmits only task-oriented features, has rapidly emerged. However, since feature extraction relies on learning-based models, its performance fundamentally depends on the training dataset or tasks. For practical scenarios, it is essential to design a model that demonstrates robust performance regardless of dataset or tasks. In this correspondence, we propose a novel text transmission model that selects and transmits only a few characters and recovers the missing characters at the receiver using a large language model (LLM). Additionally, we propose a novel importance character extractor (ICE), which selects transmitted characters to enhance LLM recovery performance. Simulations demonstrate that the proposed filter selection by ICE outperforms random filter selection, which selects transmitted characters randomly. Moreover, the proposed model exhibits robust performance across different datasets and tasks and outperforms traditional bit-based communication in low signal-to-noise ratio conditions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 24 references that are in the map. First posted on arXiv 19 Mar 2025.
Builds on
13 of 24 references.
References · 13
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2023A Survey on Evaluation of Large Language Modelscited by 1,242
- 2018CoQA: A Conversational Question Answering Challengecited by 683
- 2020Deep Learning Enabled Semantic Communication Systemscited by 292
- 2022Semantic Communications for Future Internet: Fundamentals, Applications, and Challengescited by 95
- 2018Deep Learning for Joint Source-Channel Coding of Textcited by 69
- 2023Large Language Model Enhanced Multi-Agent Systems for 6G Communicationscited by 53
- 2022A Unified Multi-Task Semantic Communication System for Multimodal Datacited by 41
- 2024A Survey on Large Language Models for Communication, Network, and Service Management: Application Insights, Challenges, and Future Directionscited by 25
1 more
Built on by
Not cited yet.