Group Pattern Selection Optimization: Let LRMs Pick the Right Pattern for Reasoning
On the map: LLM reasoning → Reinforcement learning for reasoning
Abstract (arXiv)
Large reasoning models (LRMs) exhibit diverse high-level reasoning patterns (e.g., direct solution, reflection-and-verification, and exploring multiple solutions), yet prevailing training recipes implicitly bias models toward a limited set of dominant patterns. Through a systematic analysis, we identify substantial accuracy variance across these patterns on mathematics and science benchmarks, revealing that a model's default reasoning pattern is often sub-optimal for a given problem. To address this, we introduce Group Pattern Selection Optimization (GPSO), a reinforcement learning framework that extends GRPO by incorporating multi-pattern rollouts, verifier-guided optimal pattern selection per problem, and attention masking during optimization to prevent the leakage of explicit pattern suffixes into the learned policy. By exploring a portfolio of diverse reasoning strategies and optimizing the policy on the most effective ones, GPSO enables the model to internalize the mapping from problem characteristics to optimal reasoning patterns. Extensive experiments demonstrate that GPSO delivers consistent and substantial performance gains across various model backbones and benchmarks, effectively mitigating pattern sub-optimality and fostering more robust, adaptable reasoning. All data and codes are available at https://github.com/wanghanbinpanda/GPSO.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reinforcement learning for reasoning, one of 17 directions in LLM reasoning. Builds on 47 of its 53 references that are in the map. First posted on arXiv 12 Jan 2026.
Builds on
47 of 53 references.
Closest ancestors · 21
Same direction, newest first
- 2025VL Norm: Rethink Loss Aggregation in RLVR9 Sep
- 2025Self-Aligned Reward: Towards Effective and Efficient Reasoners5 Sep
- 2025Implicit Actor Critic Coupling via a Supervised Learning Framework for RLVR2 Sep
- 2025Towards High Data Efficiency in Reinforcement Learning with Verifiable Reward1 Sep
- 2025Depth-Breadth Synergy in RLVR: Unlocking LLM Reasoning Gains with Adaptive Exploration19 Aug
- 2025Pass@k Training for Adaptively Balancing Exploration and Exploitation of Large Reasoning Models14 Aug
- 2025Reshaping Reasoning in LLMs: A Theoretical Analysis of RL Training Dynamics through Pattern Selection5 Jun
- 2025ProRL: Prolonged Reinforcement Learning Expands Reasoning Boundaries in Large Language Models30 May
- 2025AReaL: A Large-Scale Asynchronous Reinforcement Learning System for Language Reasoning30 May
- 2025ARM: Adaptive Reasoning Model26 May
- 2025Crossing the Reward Bridge: Expanding RL with Verifiable Rewards Across Diverse Domains31 Mar
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scale18 Mar
9 more
- 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRs3 Mar
- 2025Logic-RL: Unleashing LLM Reasoning with Rule-Based Reinforcement Learning20 Feb
- 2025LIMR: Less is More for RL Scaling17 Feb
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning22 Jan
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMs22 Jan
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Training22 Nov
- 2024On Designing Effective RL Reward at Training Time for LLM Reasoning19 Oct
- 2022Constitutional AI: Harmlessness from AI Feedback15 Dec
- 2017Proximal Policy Optimization Algorithms20 Jul
Other references · 26
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 733
- 2025LIMO: Less is More for Reasoningcited by 498
- 2025Light-R1: Curriculum SFT, DPO and RL for Long COT from Scratch and Beyondcited by 175
- 2025AdaptThink: Reasoning Models Can Learn When to Thinkcited by 147
- 2025Thinkless: LLM Learns When to Thinkcited by 113
14 more
- 2025The Invisible Leash: Why RLVR May or May Not Escape Its Origincited by 97
- 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homescited by 82
- 2025Enigmata: Scaling Logical Reasoning in Large Language Models with Synthetic Verifiable Puzzlescited by 56
- 2025Perception-R1: Advancing Multimodal Reasoning Capabilities of MLLMs via Visual Perception Rewardcited by 45
- 2024MMCode: Benchmarking Multimodal Large Language Models for Code Generation with Visually Rich Programming Problemscited by 40
- 2025Ada-R1: Hybrid-CoT via Bi-Level Adaptive Reasoning Optimizationcited by 33
- 2025MoDoMoDo: Multi-Domain Data Mixtures for Multimodal LLM Reinforcement Learningcited by 30
- 2025ThinkPatterns-21k: A Systematic Study on the Impact of Thinking Patterns in LLMscited by 16
- 2024COAST: Enhancing the Code Debugging Ability of LLMs through Communicative Agent Based Data Synthesiscited by 13
- 2025K2-Think: A Parameter-Efficient Reasoning Systemcited by 11
- 2025TDRM: Smooth Reward Models with Temporal Difference for LLM RL and Inferencecited by 8
- 2025Symbolic Graphics Programming with Large Language Modelscited by 7
- 2025Towards an AI Musician: Synthesizing Sheet Music Problems for Musical Reasoningcited by 6
- 2025Visual Programmability: A Guide for Code-as-Thought in Chart Understandingcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Mitigating Think-Answer Mismatch in LLM Reasoning Through Noise-Aware Advantage Reweighting
- 2025Scaf-GRPO: Scaffolded Group Relative Policy Optimization for Enhancing LLM Reasoning
- 2026BPPO: Binary Prefix Policy Optimization for Efficient GRPO-Style Reasoning RL with Concise Responses
- 2026PrAg-PO: Prompt Augmented Policy Optimization for Robust and Diverse Mathematical Reasoning
- 2025CoRPO: Adding a Correctness Bias to GRPO Improves Generalization
- 2025Stepwise Guided Policy Optimization: Coloring your Incorrect Reasoning in GRPO
- 2026Unbiased Dynamic Pruning for Efficient Group-Based Policy Optimization
- 2026Understanding Evolution Strategies for LLM Reasoning: Broader Reasoning Coverage than GRPO