mlsanityData to 14 Oct 2026

PLUME: Building a Network-Native Foundation Model for Wireless Traces via Protocol-Aware Tokenization

arXiv 2603.13647 ↗First posted 13 Mar 2026cs.LG cs.NIcited by 2

Not on the map. Why?

Abstract (arXiv)

Foundation models succeed when they learn in the native structure of a modality, whether morphology-respecting tokens in language or pixels in vision. Wireless packet traces deserve the same treatment: meaning emerges from layered headers, typed fields, timing gaps, and cross-packet state machines, not flat strings. We present Plume (Protocol Language Understanding Model for Exchanges), a compact 140M-parameter foundation model for 802.11 traces that learns from structured PDML dissections. A protocol-aware tokenizer splits along the dissector field tree, emits gap tokens for timing, and normalizes identifiers, yielding 6.2x shorter sequences than BPE with higher per token information density. Trained on a curated corpus, Plume achieves 74-97% next-packet token accuracy across five real-world failure categories and AUROC >= 0.99 for zero-shot anomaly detection. On the same prediction task, frontier LLMs (Claude Opus 4.6, GPT-5.4) score comparably despite receiving identical protocol context, yet Plume does so with > 600x fewer parameters, fitting on a single GPU at effectively zero marginal cost vs. cloud API pricing, enabling on-prem, privacy-preserving root cause analysis.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 25 of its 42 references that are in the map. First posted on arXiv 13 Mar 2026.

Builds on

25 of 42 references.

References · 25

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  6. 2020Scaling Laws for Neural Language Modelscited by 6,586
  7. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  8. 2017On Calibration of Modern Neural Networkscited by 4,960
  9. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  10. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
  11. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  12. 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 763
13 more
  1. 2023DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretrainingcited by 399
  2. 2024Byte Latent Transformer: Patches Scale Better Than Tokenscited by 146
  3. 2023AnglE-optimized Text Embeddingscited by 99
  4. 2024NetLLM: Adapting Large Language Models for Networkingcited by 78
  5. 2022ET-BERT: A Contextualized Datagram Representation with Pre-training Transformers for Encrypted Traffic Classificationcited by 66
  6. 2023NetGPT: Generative Pretrained Transformer for Network Trafficcited by 31
  7. 2023NetDiffusion: Network Data Augmentation Through Protocol-Constrained Traffic Generationcited by 27
  8. 2024NetMamba: Efficient Network Traffic Classification via Pre-training Unidirectional Mambacited by 24
  9. 2023netFound: Principled Design for Network Foundation Modelscited by 17
  10. 2024TrafficGPT: Breaking the Token Barrier for Efficient Long Traffic Analysis and Generationcited by 15
  11. 2025TrafficLLM: Enhancing Large Language Models for Network Traffic Analysis with Generic Traffic Representationcited by 15
  12. 2024Lens: A Knowledge-Guided Foundation Model for Network Trafficcited by 7
  13. 2024LLMcap: Large Language Model for Unsupervised PCAP Failure Detectioncited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.