AdaC-GRPO: Towards Mastering Long-Horizon Visual Sudoku Puzzles via Adaptive Curriculum Learning
On the map: LLM reasoning → Reinforcement learning for reasoning
Abstract (arXiv)
While reinforcement learning with verifiable reward (RLVR) enhances reasoning in large language models, its efficacy in long-horizon multimodal tasks remains underexplored. Visual Sudoku puzzles pose a representative challenge, requiring multi-step deductive reasoning over both local constraints and global dependency chains. To this end, we introduce FG-Sudoku, a fine-grained benchmark categorized by grid size and required deductive steps. Evaluations reveal that frontier MLLMs fail on complex long-range dependencies (e.g., 9*9 puzzles). During post-training, this near-zero success rate causes severe reward sparsity, halting standard RLVR. We propose Adaptive Curriculum Group Relative Policy Optimization (AdaC-GRPO) to overcome this. Unlike rigid or prior-based schedules, AdaC-GRPO dynamically constructs training batches by tracking the model's "Zone of Proximal Development" via online rollout accuracy. Experiments demonstrate that AdaC-GRPO enables Qwen2.5-VL-7B to approach the performance of Gemini-2.5-Flash while bridging 62.2% of the overall accuracy gap to Gemini-2.5-Pro, with its generalizability further validated across InternVL-3.5 and Qwen3-VL.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reinforcement learning for reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 46 references that are in the map. First posted on arXiv 9 Oct 2026.
Builds on
32 of 46 references.
Closest ancestors · 1
Same direction, newest first
Other references · 31
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
- 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,457
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
- 2018From Recognition to Cognition: Visual Commonsense Reasoningcited by 556
19 more
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
- 2024TempCompass: Do Video LLMs Really Understand Videos?cited by 363
- 2017Automated Curriculum Learning for Neural Networkscited by 257
- 2021ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learningcited by 256
- 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 236
- 2017Teacher-Student Curriculum Learningcited by 210
- 2025ZebraLogic: On the Scaling Limits of LLMs for Logical Reasoningcited by 201
- 2024RL-VLM-F: Reinforcement Learning from Vision Language Foundation Model Feedbackcited by 156
- 2025MMVU: Measuring Expert-Level Multi-Discipline Video Understandingcited by 137
- 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?cited by 118
- 2024MathBench: Evaluating the Theory and Application Proficiency of LLMs with a Hierarchical Mathematics Benchmarkcited by 105
- 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoningcited by 84
- 2024PuzzleVQA: Diagnosing Multimodal Reasoning Challenges of Language Models with Abstract Visual Patternscited by 57
- 2025Sudoku-Bench: Evaluating creative reasoning with Sudoku variantscited by 22
- 2025VideoReasonBench: Can MLLMs Perform Vision-Centric Complex Video Reasoning?cited by 20
- 2025PuzzleBench: A Fully Dynamic Evaluation Framework for Large Multimodal Models on Puzzle Solvingcited by 17
- 2025MMMG: A Massive, Multidisciplinary, Multi-Tier Generation Benchmark for Text-to-Image Reasoningcited by 16
- 2025CrossWordBench: Evaluating the Reasoning Capabilities of LLMs and LVLMs with Controllable Puzzle Generationcited by 10
- 2025ReasonBENCH: Benchmarking the (In)Stability of LLM Reasoningcited by 9
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026MaxSAT-Based Feedback for Guiding Vision-Language Models in Sudoku
- 2025Accelerating Training Speed of Tiny Recursive Models with Curriculum Guided Adaptive Recursion
- 2025Teaching Transformers to Solve Combinatorial Problems through Efficient Trial & Error
- 2024Causal Language Modeling Can Elicit Search and Reasoning Capabilities on Logic Puzzles
- 2025AdaCuRL: Adaptive Curriculum Reinforcement Learning with Invalid Sample Mitigation and Historical Revisiting
- 2025Efficient Reinforcement Finetuning via Adaptive Curriculum Learning
- 2026Not Too Hard, Not Too Easy: Learning from Intermediate States for LLM Structured Reasoning
- 2026DiBS: Diffusion-Informed Branch Selection