mlsanityData to 14 Oct 2026

Learning to Pose Problems: Reasoning-Driven and Solver-Adaptive Data Synthesis

arXiv 2511.09907 ↗First posted 13 Nov 2025cs.AI cs.CVcited by 8

On the map: LLM reasoning → Mathematical reasoning

also in 1 more
Abstract (arXiv)

Data synthesis for training large reasoning models offers a scalable alternative to limited, human-curated datasets, enabling the creation of high-quality data. However, existing approaches face several challenges: (i) indiscriminate generation that ignores the solver's ability and yields low-value problems, or reliance on complex data pipelines to balance problem difficulty; and (ii) a lack of reasoning in problem generation, leading to shallow problem variants. In this paper, we develop a problem generator that reasons explicitly to plan problem directions before synthesis and adapts difficulty to the solver's ability. We recover problem-design CoT from human-authored multi-part questions, using later subquestions as targets to infer the design rationale. These traces initialize the generator, which is then optimized with a seed-conditioned reward based on solver answer consistency. The reward guides difficulty adjustment relative to each seed while favoring problems near the solver's competence boundary. Across 10 mathematical and general reasoning benchmarks, our method outperforms seed-only training by 2.69 and 3.39 percentage points after one and three rounds, respectively. The framework also extends to vision-language models. Our code is publicly available at https://github.com/WalkerWorldPeace/Reasoning-Synthesis.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 57 of its 67 references that are in the map. First posted on arXiv 13 Nov 2025.

Builds on

57 of 67 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025ScaleDiff: Scaling Difficult Problems for Advanced Mathematical Reasoning25 Sep
  2. 2024RL on Incorrect Synthetic Data Scales the Efficiency of LLM Math Reasoning by Eight-Fold20 Jun
  3. 2024JiuZhang3.0: Efficiently Improving Mathematical Reasoning by Training Small Data Synthesis Models23 May
  4. 2024MathScale: Scaling Instruction Tuning for Mathematical Reasoning5 Mar
  5. 2024MathGenie: Generating Synthetic Data with Question Back-translation for Enhancing Mathematical Reasoning of LLMs26 Feb
  6. 2024OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset15 Feb
  7. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models5 Feb
  8. 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instruct18 Aug
  9. 2022Solving Quantitative Reasoning Problems with Language Models29 Jun

Other references · 48

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  6. 2025Qwen2.5-VL Technical Reportcited by 5,587
  7. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  8. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  9. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  10. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
  11. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
  12. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
36 more
  1. 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
  2. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
  3. 2023MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Modelscited by 735
  4. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
  5. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
  6. 2025SimpleRL-Zoo: Investigating and Taming Zero Reinforcement Learning for Open Base Models in the Wildcited by 511
  7. 2023MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuningcited by 487
  8. 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 383
  9. 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 344
  10. 2024Skywork-Reward: Bag of Tricks for Reward Modeling in LLMscited by 327
  11. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learningcited by 303
  12. 2025Learning to Reason under Off-Policy Guidancecited by 281
  13. 2025TTRL: Test-Time Reinforcement Learningcited by 275
  14. 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 228
  15. 2025BIG-Bench Extra Hardcited by 125
  16. 2024Small Language Models Need Strong Verifiers to Self-Correct Reasoningcited by 86
  17. 2024VL-RewardBench: A Challenging Benchmark for Vision-Language Generative Reward Modelscited by 86
  18. 2025Reinforcing General Reasoning without Verifierscited by 77
  19. 2024Critic-V: VLM Critics Help Catch VLM Errors in Multimodal Reasoningcited by 50
  20. 2024Thinking LLMs: General Instruction Following with Thought Generationcited by 45
  21. 2025SwS: Self-aware Weakness-driven Problem Synthesis in Reinforcement Learning for LLM Reasoningcited by 42
  22. 2025Modeling Multi-Task Model Merging as Adaptive Projective Gradient Descentcited by 39
  23. 2024Enhancing Video-LLM Reasoning via Agent-of-Thoughts Distillationcited by 37
  24. 2025MV-MATH: Evaluating Multimodal Math Reasoning in Multi-Visual Contextscited by 32
  25. 2025CoT-Self-Instruct: Building high-quality synthetic prompts for reasoning and non-reasoning taskscited by 32
  26. 2025Socratic-Zero : Bootstrapping Reasoning via Data-Free Agent Co-evolutioncited by 27
  27. 2025Language Models that Think, Chat Bettercited by 24
  28. 2025Synthetic Data is an Elegant GIFT for Continual Vision-Language Modelscited by 21
  29. 2024Synthesize Step-by-Step: Tools, Templates and LLMs as Data Generators for Reasoning-Based Chart VQAcited by 19
  30. 2025Compute as Teacher: Turning Inference Compute Into Reference-Free Supervisioncited by 18
  31. 2024Img-Diff: Contrastive Data Synthesis for Multimodal Large Language Modelscited by 17
  32. 2025Synthetic Data RL: Task Definition Is All You Needcited by 15
  33. 2025OptMerge: Unifying Multimodal LLM Capabilities and Modalities via Model Mergingcited by 13
  34. 2024FREE: Faster and Better Data-Free Meta-Learningcited by 8
  35. 2025SCOUT: Teaching Pre-trained Language Models to Enhance Reasoning via Flow Chain-of-Thoughtcited by 7
  36. 2025Mixture of Neuron Expertscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 7.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025SPARQ: Synthetic Problem Generation for Reasoning via Quality-Diversity Algorithms
  2. 2026Reasoning Core: A Scalable Procedural Data Generation Suite for Symbolic Pre-training and Post-Training
  3. 2026MathAgent: Adversarial Evolution of Constraint Graphs for Mathematical Reasoning Data Synthesis
  4. 2025MetaLadder: Ascending Mathematical Solution Quality via Analogical-Problem Reasoning Transfer
  5. 2026Recursive Harness Self-Improvement for Frontier Reasoning Data Synthesis
  6. 2025Synthesis by Design: Controlled Data Generation via Structural Guidance
  7. 2025QueST: Incentivizing LLMs to Generate Difficult Problems
  8. 2026D'ej`aQ: Open-Ended Evolution of Diverse, Learnable and Verifiable Problems