mlsanityData to 7 Oct 2026

StAR: Segment Anything Reasoner

arXiv 2603.14382 ↗First posted 15 Mar 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

As AI systems are being integrated more rapidly into diverse and complex real-world environments, the ability to perform holistic reasoning over an implicit query and an image to localize a target is becoming increasingly important. However, recent reasoning segmentation methods fail to sufficiently elicit the visual reasoning capabilities of the base mode. In this work, we present Segment Anything Reasoner (StAR), a comprehensive framework that refines the design space from multiple perspectives-including parameter-tuning scheme, reward functions, learning strategies and answer format-and achieves substantial improvements over recent baselines. In addition, for the first time, we successfully introduce parallel test-time scaling to the segmentation task, pushing the performance boundary even further. To extend the scope and depth of reasoning covered by existing benchmark, we also construct the ReasonSeg-X, which compactly defines reasoning types and includes samples that require deeper reasoning. Leveraging this dataset, we train StAR with a rollout-expanded selective-tuning approach to activate the base model's latent reasoning capabilities, and establish a rigorous benchmark for systematic, fine-grained evaluation of advanced methods. With only 5k training samples, StAR achieves significant gains over its base counterparts across extensive benchmarks, demonstrating that our method effectively brings dormant reasoning competence to the surface.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 60 of its 74 references that are in the map. First posted on arXiv 15 Mar 2026.

Builds on

60 of 74 references.

References · 60

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  6. 2023Segment Anythingcited by 8,158
  7. 2023Visual Instruction Tuningcited by 7,792
  8. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  9. 2025Qwen2.5-VL Technical Reportcited by 5,418
  10. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  11. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  12. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
38 more
  1. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  2. 2025Qwen3-VL Technical Reportcited by 2,534
  3. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  4. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
  5. 2025s1: Simple test-time scalingcited by 1,311
  6. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
  7. 2016Modeling Context in Referring Expressionscited by 1,054
  8. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 988
  9. 2025OpenAI GPT-5 System Cardcited by 910
  10. 2025SAM 3: Segment Anything with Conceptscited by 835
  11. 2023LISA: Reasoning Segmentation via Large Language Modelcited by 770
  12. 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 550
  13. 2025Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learning for LLM Reasoningcited by 540
  14. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 446
  15. 2024Training Language Models to Self-Correct via Reinforcement Learningcited by 405
  16. 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learningcited by 315
  17. 2024LoRA Learns Less and Forgets Lesscited by 313
  18. 2023GRES: Generalized Referring Expression Segmentationcited by 252
  19. 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcementcited by 234
  20. 2023PixelLM: Pixel Reasoning with Large Multimodal Modelcited by 220
  21. 2025Scalable Best-of-N Selection for Large Language Models via Self-Certaintycited by 182
  22. 2024Recursive Introspection: Teaching Language Model Agents How to Self-Improvecited by 162
  23. 2025The Surprising Effectiveness of Negative Reinforcement in LLM Reasoningcited by 158
  24. 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Roboticscited by 125
  25. 2024MiLoRA: Harnessing Minor Singular Components for Parameter-Efficient LLM Finetuningcited by 89
  26. 2024Inference-Aware Fine-Tuning for Best-of-N Sampling in Large Language Modelscited by 86
  27. 2025Not All Rollouts are Useful: Down-Sampling Rollouts in LLM Reinforcement Learningcited by 84
  28. 2025More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Modelscited by 84
  29. 2025Scaling Test-Time Compute Without Verification or RL is Suboptimalcited by 82
  30. 2025What Makes a Reward Model a Good Teacher? An Optimization Perspectivecited by 70
  31. 2025Does Thinking More always Help? Mirage of Test-Time Scaling in Reasoning Modelscited by 52
  32. 2025VisionReasoner: Unified Reasoning-Integrated Visual Perception via Reinforcement Learningcited by 50
  33. 2025Spotlight on Token Perception for Multimodal Reinforcement Learningcited by 37
  34. 2025On the Effect of Negative Gradient in Group Relative Deep Reinforcement Optimizationcited by 31
  35. 2025SAM-R1: Leveraging SAM for Reward Feedback in Multimodal Segmentation via Reinforcement Learningcited by 31
  36. 2025MMR: A Large-scale Benchmark Dataset for Multi-target and Multi-granularity Reasoning Segmentationcited by 28
  37. 2025More Thought, Less Accuracy? On the Dual Nature of Reasoning in Vision-Language Modelscited by 26
  38. 2024CoReS: Orchestrating the Dance of Reasoning and Segmentationcited by 25

50 most cited of 60 All 60 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Reasoning Segmentation for Images and Videos: A Survey
  2. 2025Fast Reasoning Segmentation for Images and Videos
  3. 2026Reason Twice: Segmentation via Candidate Discovery and Comparative Reasoning
  4. 2022STaR: Bootstrapping Reasoning With Reasoning
  5. 2026CoT-Seg: Rethinking Segmentation with Chain-of-Thought Reasoning and Self-Correction
  6. 2026GEAR-Seg: A Grounded Explainable Agent for Reasoning Segmentation and Data Engine
  7. 2024LLM-Seg: Bridging Image Segmentation and Large Language Model Reasoning
  8. 2025HoneyBee: Data Recipes for Vision-Language Reasoners