Learning to Pose Problems: Reasoning-Driven and Solver-Adaptive Data Synthesis
On the map: LLM reasoning → Mathematical reasoning
also in 1 more
Abstract (arXiv)
Data synthesis for training large reasoning models offers a scalable alternative to limited, human-curated datasets, enabling the creation of high-quality data. However, existing approaches face several challenges: (i) indiscriminate generation that ignores the solver's ability and yields low-value problems, or reliance on complex data pipelines to balance problem difficulty; and (ii) a lack of reasoning in problem generation, leading to shallow problem variants. In this paper, we develop a problem generator that reasons explicitly to plan problem directions before synthesis and adapts difficulty to the solver's ability. We recover problem-design CoT from human-authored multi-part questions, using later subquestions as targets to infer the design rationale. These traces initialize the generator, which is then optimized with a seed-conditioned reward based on solver answer consistency. The reward guides difficulty adjustment relative to each seed while favoring problems near the solver's competence boundary. Across 10 mathematical and general reasoning benchmarks, our method outperforms seed-only training by 2.69 and 3.39 percentage points after one and three rounds, respectively. The framework also extends to vision-language models. Our code is publicly available at https://github.com/WalkerWorldPeace/Reasoning-Synthesis.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 57 of its 67 references that are in the map. First posted on arXiv 13 Nov 2025.
Builds on
57 of 67 references.
Closest ancestors · 9
Same direction, newest first
- 2025ScaleDiff: Scaling Difficult Problems for Advanced Mathematical Reasoning25 Sep
- 2024RL on Incorrect Synthetic Data Scales the Efficiency of LLM Math Reasoning by Eight-Fold20 Jun
- 2024JiuZhang3.0: Efficiently Improving Mathematical Reasoning by Training Small Data Synthesis Models23 May
- 2024MathScale: Scaling Instruction Tuning for Mathematical Reasoning5 Mar
- 2024MathGenie: Generating Synthetic Data with Question Back-translation for Enhancing Mathematical Reasoning of LLMs26 Feb
- 2024OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset15 Feb
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models5 Feb
- 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instruct18 Aug
- 2022Solving Quantitative Reasoning Problems with Language Models29 Jun
Other references · 48
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
36 more
- 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
- 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
- 2023MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Modelscited by 735
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
- 2025SimpleRL-Zoo: Investigating and Taming Zero Reinforcement Learning for Open Base Models in the Wildcited by 511
- 2023MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuningcited by 487
- 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 383
- 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 344
- 2024Skywork-Reward: Bag of Tricks for Reward Modeling in LLMscited by 327
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learningcited by 303
- 2025Learning to Reason under Off-Policy Guidancecited by 281
- 2025TTRL: Test-Time Reinforcement Learningcited by 275
- 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 228
- 2025BIG-Bench Extra Hardcited by 125
- 2024Small Language Models Need Strong Verifiers to Self-Correct Reasoningcited by 86
- 2024VL-RewardBench: A Challenging Benchmark for Vision-Language Generative Reward Modelscited by 86
- 2025Reinforcing General Reasoning without Verifierscited by 77
- 2024Critic-V: VLM Critics Help Catch VLM Errors in Multimodal Reasoningcited by 50
- 2024Thinking LLMs: General Instruction Following with Thought Generationcited by 45
- 2025SwS: Self-aware Weakness-driven Problem Synthesis in Reinforcement Learning for LLM Reasoningcited by 42
- 2025Modeling Multi-Task Model Merging as Adaptive Projective Gradient Descentcited by 39
- 2024Enhancing Video-LLM Reasoning via Agent-of-Thoughts Distillationcited by 37
- 2025MV-MATH: Evaluating Multimodal Math Reasoning in Multi-Visual Contextscited by 32
- 2025CoT-Self-Instruct: Building high-quality synthetic prompts for reasoning and non-reasoning taskscited by 32
- 2025Socratic-Zero : Bootstrapping Reasoning via Data-Free Agent Co-evolutioncited by 27
- 2025Language Models that Think, Chat Bettercited by 24
- 2025Synthetic Data is an Elegant GIFT for Continual Vision-Language Modelscited by 21
- 2024Synthesize Step-by-Step: Tools, Templates and LLMs as Data Generators for Reasoning-Based Chart VQAcited by 19
- 2025Compute as Teacher: Turning Inference Compute Into Reference-Free Supervisioncited by 18
- 2024Img-Diff: Contrastive Data Synthesis for Multimodal Large Language Modelscited by 17
- 2025Synthetic Data RL: Task Definition Is All You Needcited by 15
- 2025OptMerge: Unifying Multimodal LLM Capabilities and Modalities via Model Mergingcited by 13
- 2024FREE: Faster and Better Data-Free Meta-Learningcited by 8
- 2025SCOUT: Teaching Pre-trained Language Models to Enhance Reasoning via Flow Chain-of-Thoughtcited by 7
- 2025Mixture of Neuron Expertscited by 7
Built on by
Citing papers per year: 2025: 1; 2026: 7.
8 papers.
- 2025VQRAE: Representation Quantization Autoencoders for Multimodal Understanding, Generation and Reconstructioncited by 10
- 2026Skywork UniPic 3.0: Unified Multi-Image Composition via Sequence Modelingcited by 7
- 2026Memory Grafting: Scaling Language Model Pre-training via Offline Conditional Memorycited by 5
- 2026LABSHIELD: A Multimodal Benchmark for Safety-Critical Reasoning and Planning in Scientific Laboratoriescited by 3
- 2026Preventing Curriculum Collapse in Self-Evolving Reasoning Systemscited by 2
- 2026PromptHub: Enhancing Multi-Prompt Visual In-Context Learning with Locality-Aware Fusion, Concentration and Alignmentcited by 2
- 2026From Content to Knowledge: Lightning Fast Long-Video Understanding with Neural Knowledge Representationscited by 0
- 2026MemAgent: Learning to Manage Heterogeneous Memory Providers for LLM Agentscited by 0
- 2026MemAgent: Learning to Manage Heterogeneous Memory Providers for LLM Agents26 Sep 2026
- 2026From Content to Knowledge: Lightning Fast Long-Video Understanding with Neural Knowledge Representations10 Jun 2026
- 2026Memory Grafting: Scaling Language Model Pre-training via Offline Conditional Memory20 May 2026
- 2026PromptHub: Enhancing Multi-Prompt Visual In-Context Learning with Locality-Aware Fusion, Concentration and Alignment19 Mar 2026
- 2026LABSHIELD: A Multimodal Benchmark for Safety-Critical Reasoning and Planning in Scientific Laboratories12 Mar 2026
- 2026Preventing Curriculum Collapse in Self-Evolving Reasoning Systems3 Mar 2026
- 2026Skywork UniPic 3.0: Unified Multi-Image Composition via Sequence Modeling22 Jan 2026
- 2025VQRAE: Representation Quantization Autoencoders for Multimodal Understanding, Generation and Reconstruction28 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025SPARQ: Synthetic Problem Generation for Reasoning via Quality-Diversity Algorithms
- 2026Reasoning Core: A Scalable Procedural Data Generation Suite for Symbolic Pre-training and Post-Training
- 2026MathAgent: Adversarial Evolution of Constraint Graphs for Mathematical Reasoning Data Synthesis
- 2025MetaLadder: Ascending Mathematical Solution Quality via Analogical-Problem Reasoning Transfer
- 2026Recursive Harness Self-Improvement for Frontier Reasoning Data Synthesis
- 2025Synthesis by Design: Controlled Data Generation via Structural Guidance
- 2025QueST: Incentivizing LLMs to Generate Difficult Problems
- 2026D'ej`aQ: Open-Ended Evolution of Diverse, Learnable and Verifiable Problems