mlsanityData to 14 Oct 2026

Subtle Injection for Ground-truth Inference of LLM Training Data

arXiv 2606.06502 ↗First posted 18 May 2026cs.CRcited by 0

On the map: LLM safety and security → Membership inference attacks

Abstract (arXiv)

As large language models (LLMs) are increasingly trained on scraped web corpora without authorisation, content owners require forensic methods to prove that their documents were included in a model's training set. We propose SIGIL (Subtle Injection for Ground-truth Inference of LLM training data), a framework that embeds imperceptible canary sequences into protected text and code such that any LLM trained on those documents exhibits statistically detectable behavioural signatures when probed with targeted queries. SIGIL defines five canary strategies -- lexical-rare, lexical-phrase, syntactic, semantic, and code-pattern -- and a Membership Inference Score (MIS) grounded in the Neyman-Pearson hypothesis testing framework with formal false-positive rate (FPR) control. Simulator parameters are calibrated against the empirical membership inference literature, yielding realistic heterogeneous results across 36,000 trials: overall AUC = 0.892, rising from 0.831 at 0.1% injection to 0.947 at 10%. Detection rates range from 33% to 78% across model-size and injection-rate conditions. Code Pattern canaries achieve the highest AUC (0.903, Cohen's d = 1.84); Syntactic Structure the lowest (0.875, d = 1.63). All four experimental factors -- injection rate, model size, canary strategy, and mixture ratio -- have significant independent effects on MIS (p < 0.001). SIGIL maintains AUC > 0.86 even under 100% paraphrasing (AUC = 0.864), confirming robustness through semantic leakage that survives surface-level rewriting.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Membership inference attacks, one of 12 directions in LLM safety and security. Builds on 15 of its 24 references that are in the map. First posted on arXiv 18 May 2026.

Builds on

15 of 24 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Did the Neurons Read your Book? Document-level Membership Inference for Large Language Models23 Oct

Other references · 14

  1. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
  2. 2020Extracting Training Data from Large Language Modelscited by 2,189
  3. 2023Pythia: A Suite for Analyzing Large Language Models Across Training and Scalingcited by 1,786
  4. 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 864
  5. 2022Quantifying Memorization Across Neural Language Modelscited by 763
  6. 2023A Watermark for Large Language Modelscited by 725
  7. 2024TOFU: A Task of Fictitious Unlearning for LLMscited by 533
  8. 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defensecited by 429
  9. 2023Detecting Pretraining Data from Large Language Modelscited by 387
  10. 2023Provable Robust Watermarking for AI-Generated Textcited by 299
  11. 2025Passive Hack-Back Strategies for Cyber Attribution: Covert Vectors in Denied Environmentcited by 1
  12. 2026ARCANE: Cross-Campaign Attacker Re-identification via Passive Beacon Telemetry -- A Bayesian Network Framework for Longitudinal Cyber Attributioncited by 1
2 more
  1. 2026PHANTOM: Polymorphic Honeytoken Adaptation with Narrative-Tailored Organisational Mimicrycited by 1
  2. 2026CLOUDBURST: Cloud-Layer Observations Using Beacons for Unified Real-time Surveillance and Threat Attributioncited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Membership Inference on LLMs in the Wild
  2. 2026Detecting Data Contamination in Large Language Models
  3. 2024LLM Dataset Inference: Did you train on my dataset?
  4. 2024MIA-Tuner: Adapting Large Language Models as Pre-training Text Detector
  5. 2025As If We've Met Before: LLMs Exhibit Certainty in Recognizing Seen Files
  6. 2024MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents
  7. 2024Scaling Up Membership Inference: When and How Attacks Succeed on Large Language Models
  8. 2026Detecting Non-Membership in LLM Training Data via Rank Correlations