mlsanityData to 14 Oct 2026

Robust Conformal Intrusion Detection via Traffic-Aware Calibration and Attack-Orbit Invariance

arXiv 2609.19241 ↗First posted 22 Jul 2026cs.CR cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models fine-tuned for network intrusion detection emit single-point predictions without statistical validity guarantees. Conformal prediction supplies a finite-sample coverage guarantee, but a threshold calibrated on clean traffic fails once an adversary perturbs controllable network features. We demonstrate this failure across three intrusion detection benchmarks and propose traffic-aware conformal prediction, which calibrates on traffic drawn from the perturbation mechanism an attacker is expected to use and provably restores coverage whenever that mechanism is known and can be sampled. A stronger, adaptive attacker that queries the target model's own score can still degrade this matched-calibration guarantee. We address this second threat model by excluding attacker-controllable features and their deterministic descendants from the scored representation, and prove that this yields an exact, pathwise coverage guarantee rather than a probabilistic bound. Across three independently fine-tuned language model architectures, this representation remains completely unchanged under every evaluated attack attempt, at a quantified seven-to-fourteen-point cost in clean accuracy relative to the unrestricted feature set.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 33 references that are in the map. First posted on arXiv 22 Jul 2026.

Builds on

21 of 33 references.

References · 21

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  4. 2023Mistral 7Bcited by 3,164
  5. 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,340
  6. 2017Evasion Attacks against Machine Learning at Test Timecited by 689
  7. 2015Causal inference using invariant prediction: identification and confidence intervalscited by 536
  8. 2019Conformal Prediction Under Covariate Shiftcited by 519
  9. 2021Adaptive Conformal Inference Under Distribution Shiftcited by 375
  10. 2018Anchor regression: heterogeneous data meets causalitycited by 118
  11. 2021LogBERT: Log Anomaly Detection via BERTcited by 118
  12. 2021Modeling Realistic Adversarial Attacks against Network Intrusion Detection Systemscited by 41
9 more
  1. 2023Revolutionizing Cyber Threat Detection with Large Language Models: A privacy-preserving BERT-based Lightweight Model for IoT/IIoT Devicescited by 39
  2. 2023NetGPT: Generative Pretrained Transformer for Network Trafficcited by 31
  3. 2024Provably Robust Conformal Prediction with Improved Efficiencycited by 27
  4. 2020Evaluating and Improving Adversarial Robustness of Machine Learning-Based Network Intrusion Detectorscited by 26
  5. 2023Probabilistically robust conformal predictioncited by 25
  6. 2021On the Robustness of Domain Constraintscited by 11
  7. 2019Intriguing Properties of Adversarial ML Attacks in the Problem Space [Extended Version]cited by 7
  8. 2025Robust Conformal Prediction with a Single Binary Certificatecited by 4
  9. 2025Efficient Robust Conformal Prediction via Lipschitz-Bounded Networkscited by 4

Built on by

Not cited yet.