Seq2Seq-SC: End-to-End Semantic Communication Systems with Pre-trained Language Model
Not on the map. Why?
Abstract (arXiv)
In this work, we propose a realistic semantic network called seq2seq-SC, designed to be compatible with 5G NR and capable of working with generalized text datasets using a pre-trained language model. The goal is to achieve unprecedented communication efficiency by focusing on the meaning of messages in semantic communication. We employ a performance metric called semantic similarity, measured by BLEU for lexical similarity and SBERT for semantic similarity. Our findings demonstrate that seq2seq-SC outperforms previous models in extracting semantically meaningful information while maintaining superior performance. This study paves the way for continued advancements in semantic communication and its prospective incorporation with future wireless systems in 6G networks.
Key facts. Cited by 2 papers in the map (data through 13 Oct 2026). Builds on 11 of its 19 references that are in the map. First posted on arXiv 27 Oct 2022.
Builds on
11 of 19 references.
References · 11
- 2017Attention Is All You Needcited by 60,106
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,304
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,107
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,884
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,676
- 2015A large annotated corpus for learning natural language inferencecited by 1,841
- 2020Deep Learning Enabled Semantic Communication Systemscited by 289
- 2022Sionna: An Open-Source Library for Next-Generation Physical Layer Researchcited by 145
- 2020From Semantic Communication to Semantic-aware Networking: Model, Architecture, and Open Problemscited by 52
- 2021Attention-based Reinforcement Learning for Real-Time UAV Semantic Communicationcited by 14
- 2022One-to-Many Semantic Communication Systems: Design, Implementation, Performance Evaluationcited by 7
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.