Where Do Flow Semantics Reside? A Protocol-Native Tabular Pretraining Paradigm for Encrypted Traffic Classification
Not on the map. Why?
Abstract (arXiv)
Self-supervised masked modeling shows promise for encrypted traffic classification by masking and reconstructing raw bytes. Yet recent work reveals these methods fail to reduce reliance on labeled data despite costly pretraining: under frozen encoder evaluation, accuracy drops from greater than 0.9 to less than 0.47. We argue the root cause is inductive bias mismatch: flattening traffic into byte sequences destroys protocol-defined semantics. We identify three specific issues: 1) field unpredictability, random fields like ip.id are unlearnable yet treated as reconstruction targets; 2) embedding confusion, semantically distinct fields collapse into a unified embedding space; 3) metadata loss, capture-time metadata essential for temporal analysis is discarded. To address this, we propose a protocol-native paradigm that treats protocol-defined field semantics as architectural priors, reformulating the task to align with the data's intrinsic tabular modality rather than incrementally adapting sequence-based architectures. Instantiating this paradigm, we introduce FlowSem-MAE, a tabular masked autoencoder built on Flow Semantic Units (FSUs). It features predictability-guided filtering that focuses on learnable FSUs, FSU-specific embeddings to preserve field boundaries, and dual-axis attention to capture intra-packet and temporal patterns. FlowSem-MAE significantly outperforms state-of-the-art across datasets. With only half labeled data, it outperforms most existing methods trained on full data.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 26 references that are in the map. First posted on arXiv 9 Mar 2026.
Builds on
7 of 26 references.
References · 7
- 2017Attention Is All You Needcited by 60,361
- 2021Revisiting Deep Learning Models for Tabular Datacited by 740
- 2020A Survey on Visual Transformercited by 654
- 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 463
- 2020TaBERT: Pretraining for Joint Understanding of Textual and Tabular Datacited by 398
- 2024Masked Image Modeling: A Surveycited by 29
- 2024NetMamba: Efficient Network Traffic Classification via Pre-training Unidirectional Mambacited by 24
Built on by
Not cited yet.