mlsanityData to 7 Oct 2026

SPEC5G: A Dataset for 5G Cellular Network Protocol Analysis

arXiv 2301.09201 ↗First posted 22 Jan 2023cs.IR cs.CR cs.LGcited by 20

Not on the map. Why?

Abstract (arXiv)

5G is the 5th generation cellular network protocol. It is the state-of-the-art global wireless standard that enables an advanced kind of network designed to connect virtually everyone and everything with increased speed and reduced latency. Therefore, its development, analysis, and security are critical. However, all approaches to the 5G protocol development and security analysis, e.g., property extraction, protocol summarization, and semantic analysis of the protocol specifications and implementations are completely manual. To reduce such manual effort, in this paper, we curate SPEC5G the first-ever public 5G dataset for NLP research. The dataset contains 3,547,586 sentences with 134M words, from 13094 cellular network specifications and 13 online websites. By leveraging large-scale pre-trained language models that have achieved state-of-the-art results on NLP tasks, we use this dataset for security-related text classification and summarization. Security-related text classification can be used to extract relevant security-related properties for protocol testing. On the other hand, summarization can help developers and practitioners understand the high level of the protocol, which is itself a daunting task. Our results show the value of our 5G-centric dataset in 5G protocol analysis automation. We believe that SPEC5G will enable a new research direction into automatic analyses for the 5G cellular network protocol and numerous related downstream tasks. Our data and code are publicly available.

Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 29 of its 79 references that are in the map. First posted on arXiv 22 Jan 2023.

Builds on

29 of 79 references.

References · 29

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  6. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  7. 2020Longformer: The Long-Document Transformercited by 3,362
  8. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  9. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  10. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  11. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
  12. 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,041
17 more
  1. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
  2. 2018Neural Network Acceptability Judgmentscited by 952
  3. 2019CamemBERT: a Tasty French Language Modelcited by 368
  4. 2016SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documentscited by 245
  5. 2019Structural Scaffolds for Citation Intent Classification in Scientific Publicationscited by 129
  6. 2017Sentence Simplification with Deep Reinforcement Learningcited by 107
  7. 2020Neural CRF Model for Sentence Alignment in Text Simplificationcited by 106
  8. 2019ScisummNet: A Large Annotated Corpus and Content-Impact Models for Scientific Paper Summarization with Citation Networkscited by 73
  9. 2019Leveraging BERT for Extractive Text Summarization on Lecturescited by 63
  10. 2019Pretrained Language Models for Sequential Sentence Classificationcited by 53
  11. 2020Controllable Text Simplification with Explicit Paraphrasingcited by 53
  12. 2017A Supervised Approach to Extractive Summarisation of Scientific Paperscited by 33
  13. 2019Discourse Level Factors for Sentence Deletion in Text Simplificationcited by 19
  14. 2021Coarse2Fine: Fine-grained Text Classification on Coarsely-grained Annotated Datacited by 13
  15. 2020COUGH: A Challenge Dataset and Models for COVID-19 FAQ Retrievalcited by 10
  16. 2018A Formal Analysis of 5G Authenticationcited by 7
  17. 2020YASO: A Targeted Sentiment Analysis Evaluation Dataset for Open-Domain Reviewscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 11; 2025: 6; 2026: 2.

20 papers.

Sort:

By area:

  1. 2024WirelessLLM: Empowering Large Language Models Towards Wireless Intelligencecited by 43
  2. 2024TSpec-LLM: An Open-source Dataset for LLM Understanding of 3GPP Specificationscited by 26
  3. 2024I Don't Know: Explicit Modeling of Uncertainty with an [IDK] Tokencited by 26
  4. 2024Linguistic Intelligence in Large Language Models for Telecommunicationscited by 11
  5. 2024Leveraging Fine-Tuned Retrieval-Augmented Generation with Long-Context Support: For 3GPP Standardscited by 8
  6. 2023Adapting Foundation Models for Information Synthesis of Wireless Communication Specificationscited by 7
  7. 2024Enterprise Benchmarks for Large Language Model Evaluationcited by 5
  8. 2025Mapping the Landscape of Generative AI in Network Monitoring and Managementcited by 4
  9. 2025TeleMath: A Benchmark for Large Language Models in Telecom Mathematical Problem Solvingcited by 4
  10. 2024CellularLint: A Systematic Approach to Identify Inconsistent Behavior in Cellular Network Specificationscited by 3
  11. 2024Telco-DPR: A Hybrid Dataset for Evaluating Retrieval Models of 3GPP Technical Specificationscited by 3
  12. 2026Enhancing Large Language Models (LLMs) for Telecom using Dynamic Knowledge Graphs and Explainable Retrieval-Augmented Generationcited by 3
8 more
  1. 2024Evaluating the Efficacy of Large Language Models in Identifying Phishing Attemptscited by 2
  2. 2024TeleOracle: Fine-Tuned Retrieval-Augmented Generation with Long-Context Support for Networkcited by 2
  3. 2024Technical Language Processing for Telecommunications Specificationscited by 1
  4. 2025Enhancing Large Language Models (LLMs) for Telecommunications using Knowledge Graphs and Retrieval-Augmented Generationcited by 1
  5. 2025Beyond Benchmarks: LLM Evaluation with an Anthropomorphic and Lifecycle-oriented Roadmapcited by 1
  6. 2025Empowering Large Language Models in Wireless Communication: A Novel Dataset and Fine-Tuning Frameworkcited by 0
  7. 2025MM-Telco: Benchmarks and Multimodal Large Language Models for Telecom Applicationscited by 0
  8. 2026OTel: Building Domain-Specialized Telecom LLM Foundations for Intelligent Networkscited by 0