mlsanityData to 14 Oct 2026

AdaC-GRPO: Towards Mastering Long-Horizon Visual Sudoku Puzzles via Adaptive Curriculum Learning

arXiv 2610.13184 ↗First posted 9 Oct 2026cs.AIcited by 0

On the map: LLM reasoning → Reinforcement learning for reasoning

Abstract (arXiv)

While reinforcement learning with verifiable reward (RLVR) enhances reasoning in large language models, its efficacy in long-horizon multimodal tasks remains underexplored. Visual Sudoku puzzles pose a representative challenge, requiring multi-step deductive reasoning over both local constraints and global dependency chains. To this end, we introduce FG-Sudoku, a fine-grained benchmark categorized by grid size and required deductive steps. Evaluations reveal that frontier MLLMs fail on complex long-range dependencies (e.g., 9*9 puzzles). During post-training, this near-zero success rate causes severe reward sparsity, halting standard RLVR. We propose Adaptive Curriculum Group Relative Policy Optimization (AdaC-GRPO) to overcome this. Unlike rigid or prior-based schedules, AdaC-GRPO dynamically constructs training batches by tracking the model's "Zone of Proximal Development" via online rollout accuracy. Experiments demonstrate that AdaC-GRPO enables Qwen2.5-VL-7B to approach the performance of Gemini-2.5-Flash while bridging 62.2% of the overall accuracy gap to Gemini-2.5-Pro, with its generalizability further validated across InternVL-3.5 and Qwen3-VL.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reinforcement learning for reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 46 references that are in the map. First posted on arXiv 9 Oct 2026.

Builds on

32 of 46 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Model29 May

Other references · 31

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  5. 2017Deep reinforcement learning from human preferencescited by 3,912
  6. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  7. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  8. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
  9. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
  10. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,457
  11. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
  12. 2018From Recognition to Cognition: Visual Commonsense Reasoningcited by 556
19 more
  1. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
  2. 2024TempCompass: Do Video LLMs Really Understand Videos?cited by 363
  3. 2017Automated Curriculum Learning for Neural Networkscited by 257
  4. 2021ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learningcited by 256
  5. 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 236
  6. 2017Teacher-Student Curriculum Learningcited by 210
  7. 2025ZebraLogic: On the Scaling Limits of LLMs for Logical Reasoningcited by 201
  8. 2024RL-VLM-F: Reinforcement Learning from Vision Language Foundation Model Feedbackcited by 156
  9. 2025MMVU: Measuring Expert-Level Multi-Discipline Video Understandingcited by 137
  10. 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?cited by 118
  11. 2024MathBench: Evaluating the Theory and Application Proficiency of LLMs with a Hierarchical Mathematics Benchmarkcited by 105
  12. 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoningcited by 84
  13. 2024PuzzleVQA: Diagnosing Multimodal Reasoning Challenges of Language Models with Abstract Visual Patternscited by 57
  14. 2025Sudoku-Bench: Evaluating creative reasoning with Sudoku variantscited by 22
  15. 2025VideoReasonBench: Can MLLMs Perform Vision-Centric Complex Video Reasoning?cited by 20
  16. 2025PuzzleBench: A Fully Dynamic Evaluation Framework for Large Multimodal Models on Puzzle Solvingcited by 17
  17. 2025MMMG: A Massive, Multidisciplinary, Multi-Tier Generation Benchmark for Text-to-Image Reasoningcited by 16
  18. 2025CrossWordBench: Evaluating the Reasoning Capabilities of LLMs and LVLMs with Controllable Puzzle Generationcited by 10
  19. 2025ReasonBENCH: Benchmarking the (In)Stability of LLM Reasoningcited by 9

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026MaxSAT-Based Feedback for Guiding Vision-Language Models in Sudoku
  2. 2025Accelerating Training Speed of Tiny Recursive Models with Curriculum Guided Adaptive Recursion
  3. 2025Teaching Transformers to Solve Combinatorial Problems through Efficient Trial & Error
  4. 2024Causal Language Modeling Can Elicit Search and Reasoning Capabilities on Logic Puzzles
  5. 2025AdaCuRL: Adaptive Curriculum Reinforcement Learning with Invalid Sample Mitigation and Historical Revisiting
  6. 2025Efficient Reinforcement Finetuning via Adaptive Curriculum Learning
  7. 2026Not Too Hard, Not Too Easy: Learning from Intermediate States for LLM Structured Reasoning
  8. 2026DiBS: Diffusion-Informed Branch Selection