mlsanityData to 7 Oct 2026

ConceptSeg-R1: Segment Any Concept via Meta-Reinforcement Learning

arXiv 2605.20385 ↗First posted 19 May 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent progress in promptable segmentation has shifted visual perception from object-level localization toward concept-level understanding. However, the notion of a concept remains under-specified, making it unclear whether current methods truly generalize beyond category recognition. In this work, we formalize generalized concept segmentation through a three-level taxonomy consisting of context-independent (CI), context-dependent (CD), and context-reasoning (CR) concepts, which reveals a clear capability gap across increasing levels of cognitive complexity. To address this challenge, we propose ConceptSeg-R1, a unified framework that reformulates concept segmentation as rule-induced concept grounding. At the core of our method is Meta-GRPO, a meta-reinforcement learning mechanism that learns transferable task rules from visual demonstrations and verifies them through proxy reasoning. The inferred reasoning states are then translated into segmentation-ready concept prompts via a lightweight concept translation module, enabling deductive application to target images. A shortcut routing strategy further preserves the native efficiency of segmentation models on simple cases. To systematically evaluate generalized concept segmentation, we conduct extensive experiments across diverse CI, CD, and CR concept segmentation benchmarks spanning natural, industrial, medical and reasoning-intensive domains. Without bells and whistles, ConceptSeg-R1 achieves strong performance across the full concept hierarchy while maintaining the native capability of promptable segmentation backbones. As an initial step toward segmenting any concept, we hope ConceptSeg-R1 can serve as a practical baseline for advancing segmentation from object-level prediction toward concept-level understanding.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). First posted on arXiv 19 May 2026.

Builds on

0 of 0 references.

No references here yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement
  2. 2025VideoSeg-R1:Reasoning Video Object Segmentation via Reinforcement Learning
  3. 2024Explainable Concept Generation through Vision-Language Preference Learning for Understanding Neural Networks' Internal Representations
  4. 2025LENS: Learning to Segment Anything with Unified Reinforced Reasoning
  5. 2025Segment Anyword: Mask Prompt Inversion for Open-Set Grounded Segmentation
  6. 2025OpenSeg-R: Improving Open-Vocabulary Segmentation via Step-by-Step Visual Reasoning
  7. 2025Seg-R1: Segmentation Can Be Surprisingly Simple with Reinforcement Learning
  8. 2025What You Perceive Is What You Conceive: A Cognition-Inspired Framework for Open Vocabulary Image Segmentation