One Sample to Rule Them All: Extreme Data Efficiency in Multidiscipline Reasoning with Reinforcement Learning
On the map: LLM reasoning → Reinforcement learning for reasoning
Abstract (arXiv)
The reasoning ability of large language models (LLMs) can be unleashed with reinforcement learning (RL) (OpenAI, 2024; DeepSeek-AI et al., 2025a; Zeng et al., 2025). The success of existing RL attempts in LLMs usually rely on high-quality samples of large volumes. In this paper, we challenge conventional assumptions about data requirements in RL for LLMs by demonstrating the effectiveness of one-shot reinforcement learning. Specifically, we introduce polymath learning, a framework for designing one training sample that elicits multidisciplinary reasoning improvement. We present three key findings: (1) A single, strategically selected math reasoning sample can produce significant performance improvements across multiple domains, including physics, chemistry, and biology; (2) Analysis of salient mathematical skills provides insight into the characteristics associated with effective polymath samples; and (3) An engineered synthetic sample that integrates multidisciplinary elements and broader skill coverage achieves stronger performance than naturally occurring individual samples. Across various reasoning benchmarks, polymath learning achieves stronger performance than larger datasets, demonstrating that reasoning structure and skills in samples, rather than quantity, may be the key to unlock enhanced reasoning capabilities in language models. Our results suggest a shift, dubbed as sample engineering, toward precision engineering of samples that complements simply increasing data volume.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Reinforcement learning for reasoning, one of 17 directions in LLM reasoning. Builds on 47 of its 85 references that are in the map. First posted on arXiv 6 Jan 2026.
Builds on
47 of 85 references.
Closest ancestors · 23
Same direction, newest first
- 2025Scaling Behaviors of LLM Reinforcement Learning Post-Training: An Empirical Study in Mathematical Reasoning29 Sep
- 2025Can One Domain Help Others? A Data-Centric Study on Multi-Domain Reasoning via Reinforcement Learning23 Jul
- 2025Reasoning or Memorization? Unreliable Results of Reinforcement Learning Due to Data Contamination14 Jul
- 2025OctoThinker: Mid-training Incentivizes Reinforcement Learning Scaling25 Jun
- 2025Spurious Rewards: Rethinking Training Signals in RLVR12 Jun
- 2025SwS: Self-aware Weakness-driven Problem Synthesis in Reinforcement Learning for LLM Reasoning10 Jun
- 2025Unleashing the Reasoning Potential of Pre-trained LLMs by Critique Fine-Tuning on One Problem3 Jun
- 2025Warm Up Before You Train: Unlocking General Reasoning in Resource-Constrained Settings19 May
- 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Data6 May
- 2025Reinforcement Learning for Reasoning in Large Language Models with One Training Example29 Apr
- 2025SRPO: A Cross-Domain Implementation of Large-Scale Reinforcement Learning on LLM19 Apr
- 2025Not All Rollouts are Useful: Down-Sampling Rollouts in LLM Reinforcement Learning18 Apr
11 more
- 2025Nemotron-CrossThink: Scaling Self-Learning beyond Math Reasoning15 Apr
- 2025DeepMath-103K: A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoning15 Apr
- 2025Open-Reasoner-Zero: An Open Source Approach to Scaling Up Reinforcement Learning on the Base Model31 Mar
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scale18 Mar
- 2025Logic-RL: Unleashing LLM Reasoning with Rule-Based Reinforcement Learning20 Feb
- 2025LIMR: Less is More for RL Scaling17 Feb
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning22 Jan
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMs22 Jan
- 2025REINFORCE++: Stabilizing Critic-Free Policy Optimization with Global Advantage Normalization4 Jan
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Training22 Nov
- 2017Proximal Policy Optimization Algorithms20 Jul
Other references · 24
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2024OpenAI o1 System Cardcited by 1,220
- 2024DeepSeek-V3 Technical Reportcited by 724
- 2024LESS: Selecting Influential Data for Targeted Instruction Tuningcited by 514
- 2025LIMO: Less is More for Reasoningcited by 488
- 2023Data Selection for Language Models via Importance Resamplingcited by 322
- 2024O1 Replication Journey: A Strategic Progress Report -- Part 1cited by 140
- 2025Does Math Reasoning Improve General LLM Capabilities? Understanding Transferability of LLM Reasoningcited by 101
- 2025SuperGPQA: Scaling LLM Evaluation across 285 Graduate Disciplinescited by 67
12 more
- 2025Prismatic Synthesis: Gradient-based Data Diversification Boosts Generalization in LLM Reasoningcited by 38
- 2024Unleashing LLM Reasoning Capability via Scalable Question Synthesis from Scratchcited by 24
- 2025SynthRL: Scaling Visual Reasoning with Verifiable Data Synthesiscited by 12
- 2025Why Less is More (Sometimes): A Theory of Data Curationcited by 8
- 2024PersonaMath: Boosting Mathematical Reasoning via Persona-Driven Data Augmentationcited by 7
- 2025SPARQ: Synthetic Problem Generation for Reasoning via Quality-Diversity Algorithmscited by 7
- 2025Add-One-In: Incremental Sample Selection for Large Language Models via a Choice-Based Greedy Paradigmcited by 6
- 2025Mining Hidden Thoughts from Texts: Evaluating Continual Pretraining with Synthetic Data for LLM Reasoningcited by 6
- 2025DESIGNER: Design-Logic-Guided Multidisciplinary Data Synthesis for LLM Reasoningcited by 6
- 2024Data Diversity as Implicit Regularization: How Does Diversity Shape the Weight Space of Deep Neural Networks?cited by 4
- 2025Large-Scale Diverse Synthesis for Mid-Trainingcited by 3
- 2025Generalization or Memorization: Dynamic Decoding for Mode Steeringcited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Revisiting Reinforcement Learning for LLM Reasoning from A Cross-Domain Perspective
- 2025Scaling Up RL: Unlocking Diverse Reasoning in LLMs via Prolonged Training
- 2024Multi-Step Reasoning with Large Language Models, a Survey
- 2024Polymath: A Challenging Multi-modal Mathematical Reasoning Benchmark
- 2025LogicPuzzleRL: Cultivating Robust Mathematical Reasoning in LLMs via Reinforcement Learning
- 2025A Survey of Reinforcement Learning for Large Reasoning Models
- 2025T1: Advancing Language Model Reasoning through Reinforcement Learning and Inference Scaling
- 2025Beyond Accuracy: Dissecting Mathematical Reasoning for LLMs Under Reinforcement Learning