CoPRS: Learning Positional Prior from Chain-of-Thought for Reasoning Segmentation
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Existing works on reasoning segmentation either connect hidden features from a language model directly to a mask decoder or represent positions in text, which limits interpretability and semantic detail. To solve this, we present CoPRS, a Multi-modal Chain-of-Thought (MCoT)-based positional perception model that bridges language reasoning to segmentation through a differentiable and interpretable positional prior instantiated as a heatmap. By making the reasoning process clear via MCoT and expressing it as a dense, differentiable heatmap, this interface enhances interpretability and diagnostic analysis and yields more concentrated evidence on the target. A learnable concentration token aggregates features of the image and reasoning text to generate this positional prior, which is decoded to precise masks through a lightweight decoder, providing a direct connection between reasoning and segmentation. Across the RefCOCO series and ReasonSeg, CoPRS matches or surpasses the best reported metrics on each standard split under comparable protocols, with performance at or above the prior state of the art across both validation and test partitions. Extensive experiments demonstrate a strong positive correlation among the CoT trajectory, the generated heatmap, and the decoded mask, supporting an interpretable alignment between the reasoning output and downstream mask generation. Collectively, these findings support the utility of this paradigm in bridging reasoning and segmentation and show advantages in concentration driven by reasoning and in more precise mask prediction. Code has been released at https://github.com/ZhenyuLU-Heliodore/CoPRS.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 17 of its 52 references that are in the map. First posted on arXiv 13 Oct 2025.
Builds on
17 of 52 references.
Closest ancestors · 5
Same direction, newest first
- 2025Seg-R1: Segmentation Can Be Surprisingly Simple with Reinforcement Learning27 Jun
- 2025Perception-R1: Pioneering Perception Policy with Reinforcement Learning10 Apr
- 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement9 Mar
Other references · 12
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 2,026
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2025Group Sequence Policy Optimizationcited by 835
- 2024RLHF Workflow: From Reward Modeling to Online RLHFcited by 267
- 2024LaSagnA: Language-based Segmentation Assistant for Complex Queriescited by 55
- 2025CoS: Chain-of-Shot Prompting for Long Video Understandingcited by 27
- 2025Refer to Any Segmentation Mask Group With Vision-Language Promptscited by 5
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026LMMs Meet Object-Centric Vision: Understanding, Segmentation, Editing and Generationcited by 6
- 2026StAR: Segment Anything Reasonercited by 2
- 2026Reason Twice: Segmentation via Candidate Discovery and Comparative Reasoningcited by 2
- 2026Vision Harnessing Agent for Open Ad-hoc Segmentationcited by 1
- 2026B-GRTO: Bootstrapped Group Relative Tool Optimization for Referring Segmentationcited by 1
- 2026From RGB Generation to Dense Field Readout: Pixel-Space Dense Prediction with Text-to-Image Modelscited by 1
- 2026Can Segmentation Models Understand the World? Towards Proactive Affordance Reasoning via Visual Chain-of-Thoughtcited by 0
- 2026VideoSEG-O3: A Multi-turn Reinforcement Learning Framework for Reasoning Video Object Segmentationcited by 0
- 2026DGSeg: Dynamic Gating of Semantic-Spatial Guided Predictions for Reasoning Segmentationcited by 0
- 2026From RGB Generation to Dense Field Readout: Pixel-Space Dense Prediction with Text-to-Image Models7 Jul 2026
- 2026DGSeg: Dynamic Gating of Semantic-Spatial Guided Predictions for Reasoning Segmentation6 Jul 2026
- 2026Reason Twice: Segmentation via Candidate Discovery and Comparative Reasoning8 Jun 2026
- 2026VideoSEG-O3: A Multi-turn Reinforcement Learning Framework for Reasoning Video Object Segmentation5 Jun 2026
- 2026Can Segmentation Models Understand the World? Towards Proactive Affordance Reasoning via Visual Chain-of-Thought26 May 2026
- 2026B-GRTO: Bootstrapped Group Relative Tool Optimization for Referring Segmentation22 May 2026
- 2026Vision Harnessing Agent for Open Ad-hoc Segmentation19 May 2026
- 2026LMMs Meet Object-Centric Vision: Understanding, Segmentation, Editing and Generation13 Apr 2026
- 2026StAR: Segment Anything Reasoner15 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Think Before You Segment: High-Quality Reasoning Segmentation with GPT Chain of Thoughts
- 2024CoReS: Orchestrating the Dance of Reasoning and Segmentation
- 2026Skip the Talk, Re-Focus on Vision: Latent Reasoning for Reasoning Segmentation in Multimodal Large Language Models
- 2023LISA: Reasoning Segmentation via Large Language Model
- 2026SeGDeP: Semantic- and Geometric-Aware Decoupled Prompts for Reasoning Segmentation
- 2026AnchorSeg: Language Grounded Query Banks for Reasoning Segmentation
- 2025PixelThink: Towards Efficient Chain-of-Pixel Reasoning
- 2025RSVP: Reasoning Segmentation via Visual Prompting and Multi-modal Chain-of-Thought