Unlearning as Ablation: Toward a Falsifiable Benchmark for Generative Scientific Discovery
On the map: LLM safety and security → Machine unlearning
Abstract (arXiv)
Bold claims about AI's role in science-from "AGI will cure all diseases" to promises of radically accelerated discovery-raise a central epistemic question: do large language models (LLMs) truly generate new knowledge, or do they merely remix memorized fragments? We propose unlearning-as-ablation as a falsifiable probe of constructive scientific discovery. The idea is to systematically remove a target result together with its forget-closure (supporting lemmas, paraphrases, and multi-hop entailments) and then evaluate whether the model can re-derive the result from only permitted axioms and tools. Success would indicate generative capability beyond recall; failure would expose current limits. Unlike prevailing motivations for unlearning-privacy, copyright, or safety-our framing repositions it as an epistemic probe for AI-for-Science. We outline a minimal pilot in mathematics and algorithms to illustrate feasibility, and sketch how the same approach could later be extended to domains such as physics or chemistry. This is a position paper: our contribution is conceptual and methodological, not empirical. We aim to stimulate discussion on how principled ablation tests could help distinguish models that reconstruct knowledge from those that merely retrieve it, and how such probes might guide the next generation of AI-for-Science benchmarks.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 17 of its 24 references that are in the map. First posted on arXiv 25 Aug 2025.
Builds on
17 of 24 references.
Closest ancestors · 7
Same direction, newest first
- 2025Reasoning Model Unlearning: Forgetting Traces, Not Just Answers, While Preserving Reasoning Skills15 Jun
- 2024Breaking Chains: Unraveling the Links in Multi-Hop Knowledge Unlearning17 Oct
- 2024Avoiding Copyright Infringement via Large Language Model Unlearning16 Jun
- 2024Digital Forgetting in Large Language Models: A Survey of Unlearning Methods2 Apr
- 2024Machine Unlearning in Large Language Models3 Feb
- 2023Large Language Model Unlearning14 Oct
- 2023Machine Unlearning: Solutions and Challenges14 Aug
Other references · 10
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2022Mass-Editing Memory in a Transformercited by 1,001
- 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 509
- 2025Humanity's Last Examcited by 491
- 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 422
- 2025Accelerating scientific discovery with Co-Scientistcited by 401
- 2023Copyright Violations and Large Language Modelscited by 108
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Contemporary AI lacks the imagination to diverge or negate in science
- 2026ProjectionBench: Evaluating Scientific Hypothesis Generation in LLMs Under Progressive Information Disclosure
- 2024Towards Scientific Discovery with Generative AI: Progress, Opportunities, and Challenges
- 2025Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluation
- 2026FALSIFYBENCH: Evaluating Inductive Reasoning in LLMs with Rule Discovery Games
- 2026MOOSE-Star: Unlocking Tractable Training for Scientific Discovery by Breaking the Complexity Barrier
- 2025The Need for Verification in AI-Driven Scientific Discovery
- 2025From Reasoning to Learning: A Survey on Hypothesis Discovery and Rule Learning with Large Language Models