mlsanityData to 14 Oct 2026

When Reasoning Leaks Membership: Membership Inference Attack on Black-box Large Reasoning Models

arXiv 2601.13607 ↗First posted 20 Jan 2026cs.CRcited by 2

On the map: LLM safety and security → Membership inference attacks

Abstract (arXiv)

Large Reasoning Models (LRMs) have rapidly gained prominence for their strong performance in solving complex tasks. Many modern black-box LRMs expose the intermediate reasoning traces through APIs to improve transparency (e.g., Gemini-2.5 and Claude-sonnet). Despite their benefits, we find that these traces can leak membership signals, creating a new privacy threat even without access to token logits used in prior attacks. In this work, we initiate the first systematic exploration of Membership Inference Attacks (MIAs) on black-box LRMs. Our preliminary analysis shows that LRMs produce confident, recall-like reasoning traces on familiar training member samples but more hesitant, inference-like reasoning traces on non-members. The representations of these traces are continuously distributed in the semantic latent space, spanning from familiar to unfamiliar samples. Building on this observation, we propose BlackSpectrum, the first membership inference attack framework targeting the black-box LRMs. The key idea is to construct a recall-inference axis in the semantic latent space, based on representations derived from the exposed traces. By locating where a query sample falls along this axis, the attacker can obtain a membership score and predict how likely it is to be a member of the training data. Additionally, to address the limitations of outdated datasets unsuited to modern LRMs, we provide two new datasets to support future research, arXivReasoning and BookReasoning. Empirically, exposing reasoning traces significantly increases the vulnerability of LRMs to membership inference attacks, leading to large gains in attack performance. Our findings highlight the need for LRM companies to balance transparency in intermediate reasoning traces with privacy preservation.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Membership inference attacks, one of 12 directions in LLM safety and security. Builds on 30 of its 53 references that are in the map. First posted on arXiv 20 Jan 2026.

Builds on

30 of 53 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024A Statistical and Multi-Perspective Revisiting of the Membership Inference Attack in Large Language Models18 Dec
  2. 2024Scaling Up Membership Inference: When and How Attacks Succeed on Large Language Models31 Oct
  3. 2024Membership Inference Attacks Cannot Prove that a Model Was Trained On Your Data29 Sep
  4. 2024ReCaLL: Membership Inference via Relative Conditional Log-Likelihoods23 Jun
  5. 2021Membership Inference Attacks From First Principles7 Dec

Other references · 25

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  5. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
  6. 2020Extracting Training Data from Large Language Modelscited by 2,189
  7. 2025s1: Simple test-time scalingcited by 1,341
  8. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
  9. 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 864
  10. 2023Understanding the Effects of RLHF on LLM Generalisation and Diversitycited by 396
  11. 2023Rethinking Benchmark and Contamination for Language Models with Rephrased Samplescited by 195
  12. 2023Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-4cited by 125
13 more
  1. 2024Generalization or Memorization: Data Contamination and Trustworthy Evaluation for Large Language Modelscited by 122
  2. 2024DE-COP: Detecting Copyrighted Content in Language Models Training Datacited by 74
  3. 2025Safety in Large Reasoning Models: A Surveycited by 64
  4. 2025How much do language models memorize?cited by 61
  5. 2024Pretraining Data Detection for Large Language Models: A Divergence-based Calibration Methodcited by 55
  6. 2025Demystifying Reasoning Dynamics with Mutual Information: Thinking Tokens are Information Peaks in LLM Reasoningcited by 51
  7. 2024Internal Consistency and Self-Feedback in Large Language Models: A Surveycited by 50
  8. 2025LLMs for Explainable AI: A Comprehensive Surveycited by 45
  9. 2025A Mousetrap: Fooling Large Reasoning Models for Jailbreak with Chain of Iterative Chaoscited by 43
  10. 2025Extracting memorized pieces of (copyrighted) books from open-weight language modelscited by 30
  11. 2025Leaky Thoughts: Large Reasoning Models Are Not Private Thinkerscited by 28
  12. 2025Automated Detection of Pre-training Text in Black-box LLMscited by 6
  13. 2025Policy Frameworks for Transparent Chain-of-Thought Reasoning in Large Language Modelscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Detecting Data Contamination in Large Language Models
  2. 2025Membership Inference Attacks on Large-Scale Models: A Survey
  3. 2025On Membership Inference Attacks in Knowledge Distillation
  4. 2026What Hard Tokens Reveal: Exploiting Low-confidence Tokens for Membership Inference Attacks against Large Language Models
  5. 2025The Surprising Effectiveness of Membership Inference with Simple N-Gram Coverage
  6. 2026Pop Quiz Attack: Black-box Membership Inference Attacks Against Large Language Models
  7. 2026CheckMIABench: Firm Foundations For Membership Inference Attacks on Language Models
  8. 2025Membership Inference Attacks on Tokenizers of Large Language Models