CORA: Consistency-Guided Semi-Supervised Framework for Reasoning Segmentation
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Reasoning segmentation seeks pixel-accurate masks for targets referenced by complex, often implicit instructions, requiring context-dependent reasoning over the scene. Recent multimodal language models have advanced instruction following segmentation, yet generalization remains limited. The key bottleneck is the high cost of curating diverse, high-quality pixel annotations paired with rich linguistic supervision leading to brittle performance under distribution shift. Therefore, we present CORA, a semi-supervised reasoning segmentation framework that jointly learns from limited labeled data and a large corpus of unlabeled images. CORA introduces three main components: 1) conditional visual instructions that encode spatial and contextual relationships between objects; 2) a noisy pseudo-label filter based on the consistency of Multimodal LLM's outputs across semantically equivalent queries; and 3) a token-level contrastive alignment between labeled and pseudo-labeled samples to enhance feature consistency. These components enable CORA to perform robust reasoning segmentation with minimal supervision, outperforming existing baselines under constrained annotation settings. CORA achieves state-of-the-art results, requiring as few as 100 labeled images on Cityscapes, a benchmark dataset for urban scene understanding, surpassing the baseline by +2.3%. Similarly, CORA improves performance by +2.4% with only 180 labeled images on PanNuke, a histopathology dataset.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 54 of its 69 references that are in the map. First posted on arXiv 21 Nov 2025.
Builds on
54 of 69 references.
Closest ancestors · 4
Same direction, newest first
- 2025GLUS: Global-Local Reasoning Unified into A Single Large Language Model for Video Segmentation10 Apr
- 2024SegLLM: Multi-round Reasoning Segmentation24 Oct
- 2024LLM-Seg: Bridging Image Segmentation and Large Language Model Reasoning12 Apr
- 2023LISA: Reasoning Segmentation via Large Language Model1 Aug
Other references · 50
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2023Segment Anythingcited by 8,234
- 2023Visual Instruction Tuningcited by 7,869
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2016Modeling Context in Referring Expressionscited by 1,063
- 2015Generation and Comprehension of Unambiguous Object Descriptionscited by 904
- 2023Segment Everything Everywhere All at Oncecited by 548
- 2019Uncertainty-aware Self-ensembling Model for Semi-supervised 3D Left Atrium Segmentationcited by 379
38 more
- 2020Meta Pseudo Labelscited by 374
- 2021LAVT: Language-Aware Vision Transformer for Referring Image Segmentationcited by 348
- 2021In Defense of Pseudo-Labeling: An Uncertainty-Aware Pseudo-label Selection Framework for Semi-Supervised Learningcited by 301
- 2016Segmentation from Natural Language Expressionscited by 257
- 2021Vision-Language Transformer and Query Generation for Referring Segmentationcited by 240
- 2015Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understandingcited by 218
- 2021ST++: Make Self-training Work Better for Semi-supervised Semantic Segmentationcited by 184
- 2022Revisiting Weak-to-Strong Consistency in Semi-Supervised Semantic Segmentationcited by 178
- 2021Dash: Semi-Supervised Learning with Dynamic Thresholdingcited by 148
- 2019Semi-Supervised Semantic Segmentation with High- and Low-level Consistencycited by 147
- 2021Semi-Supervised Semantic Segmentation with Pixel-Level Contrastive Learning from a Class-wise Memory Bankcited by 125
- 2021Perturbed and Strict Mean Teachers for Semi-supervised Semantic Segmentationcited by 113
- 2024Why are Visually-Grounded Language Models Bad at Image Classification?cited by 102
- 2021Semi-Supervised Semantic Segmentation via Adaptive Equalization Learningcited by 101
- 2023NExT-Chat: An LMM for Chat, Detection and Segmentationcited by 80
- 2020DMT: Dynamic Mutual Training for Semi-Supervised Learningcited by 77
- 2022Augmentation Matters: A Simple-yet-Effective Approach to Semi-supervised Semantic Segmentationcited by 64
- 2020From Shadow Segmentation to Shadow Removalcited by 59
- 2024Do Vision-Language Models Represent Space and How? Evaluating Spatial Frame of Reference Under Ambiguitiescited by 59
- 2023Zero-shot Object Countingcited by 57
- 2024Decoupling Static and Hierarchical Motion Perception for Referring Video Segmentationcited by 55
- 2024Learning to Localize Objects Improves Spatial Reasoning in Visual-LLMscited by 49
- 2022UCC: Uncertainty guided Cross-head Co-training for Semi-Supervised Semantic Segmentationcited by 45
- 2023SemiVL: Semi-Supervised Semantic Segmentation with Vision-Language Guidancecited by 41
- 2020Physics-based Shadow Image Decomposition for Shadow Removalcited by 39
- 2022Generating Representative Samples for Few-Shot Classificationcited by 39
- 2023Learning Visual Representations via Language-Guided Samplingcited by 32
- 2024Consistency and Uncertainty: Identifying Unreliable Responses From Black-Box Vision-Language Models for Selective Visual Question Answeringcited by 32
- 2021Uncertainty guided semi-supervised segmentation of retinal layers in OCT imagescited by 29
- 2023Logic-induced Diagnostic Reasoning for Semi-supervised Semantic Segmentationcited by 29
- 2020Variational Feature Disentangling for Fine-Grained Few-Shot Classificationcited by 26
- 2023Generating Features with Increased Crop-related Diversity for Few-Shot Object Detectioncited by 21
- 2022ZigZag: Universal Sampling-free Uncertainty Estimation Through Two-Step Inferencecited by 15
- 2024Certainly Uncertain: A Benchmark and Metric for Multimodal Epistemic and Aleatoric Awarenesscited by 14
- 2019Weakly Labeling the Antarctic: The Penguin Colony Casecited by 12
- 2024Enabling Uncertainty Estimation in Iterative Neural Networkscited by 11
- 2024Assessing Sample Quality via the Latent Space of Generative Modelscited by 8
- 2024Weighting Pseudo-Labels via High-Activation Feature Index Similarity and Object Detection for Semi-Supervised Segmentationcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Reasoning Segmentation for Images and Videos: A Survey
- 2026Skip the Talk, Re-Focus on Vision: Latent Reasoning for Reasoning Segmentation in Multimodal Large Language Models
- 2026CR-Seg: Attention-Guided and CoT-Enhanced Coarse-to-Refined Reasoning Segmentation
- 2026DR2Seg: Decomposed Two-Stage Rollouts for Efficient Reasoning Segmentation in Multimodal Large Language Models
- 2026Reason Twice: Segmentation via Candidate Discovery and Comparative Reasoning
- 2026Seg-Agent: Test-Time Multimodal Reasoning for Training-Free Language-Guided Segmentation
- 2025Decoupling the Image Perception and Multimodal Reasoning for Reasoning Segmentation with Digital Twin Representations
- 2024PRIMA: Multi-Image Vision-Language Models for Reasoning Segmentation