mlsanityData to 13 Oct 2026

Progressive Reasoning with Primitive Correction for Compositional Zero-Shot Learning

arXiv 2607.05911 ↗First posted 7 Jul 2026cs.CVcited by 0

On the map: LLM reasoning → Reinforcement learning for reasoning

Abstract (arXiv)

Compositional Zero-Shot Learning (CZSL) aims to combine known attributes and objects as primitives for recognizing previously unseen attribute-object pairs. Prior works either predict attributes and objects independently, missing their strong contextual dependency, or use unidirectional conditional modeling (e.g., object-guided attribute prediction), which is prone to error propagation. We propose PRPC, a Progressive Reasoning framework with Primitive Correction, which explicitly models the bidirectional dependency between attributes and objects via step-wise inference. PRPC performs mutual correction of primitives to suppress prediction errors in earlier steps. Specifically, we formulate CZSL as structured, Q&A-style Chain-of-Thought reasoning process and constrain the MLLM to follow predefined semantic steps to generate intermediate decisions. To further enhance the reliability and logical consistency of intermediate reasoning, we introduce reinforcement learning post-training with a GRPO-based objective, providing step-level rewards aligned with the progressive inference procedure. Extensive experiments on three CZSL benchmarks demonstrate that PRPC achieves state-of-the-art performance, validating the effectiveness of progressive reasoning and bidirectional correction for robust compositional generalization.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Reinforcement learning for reasoning, one of 17 directions in LLM reasoning. Builds on 36 of its 49 references that are in the map. First posted on arXiv 7 Jul 2026.

Builds on

36 of 49 references.

References · 36

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
  2. 2022Training language models to follow instructions with human feedbackcited by 15,856
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,376
  4. 2023Visual Instruction Tuningcited by 7,827
  5. 2025Qwen2.5-VL Technical Reportcited by 5,499
  6. 2024GPT-4o System Cardcited by 4,536
  7. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,314
  8. 2017Deep reinforcement learning from human preferencescited by 3,871
  9. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,181
  10. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,864
  11. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,703
  12. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,586
24 more
  1. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,404
  2. 2021Grounded Language-Image Pre-trainingcited by 1,152
  3. 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 815
  4. 2023Aligning Large Multimodal Models with Factually Augmented RLHFcited by 708
  5. 2023ViperGPT: Visual Inference via Python Execution for Reasoningcited by 596
  6. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 566
  7. 2022Visual Programming: Compositional visual reasoning without trainingcited by 510
  8. 2023RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedbackcited by 407
  9. 2022What does a platypus look like? Generating customized prompts for zero-shot image classificationcited by 264
  10. 2019Task-Driven Modular Networks for Zero-Shot Compositional Learningcited by 121
  11. 2021Learning Graph Embeddings for Compositional Zero-shot Learningcited by 112
  12. 2021Learning to Predict Visual Attributes in the Wildcited by 95
  13. 2022Learning to Compose Soft Prompts for Compositional Zero-Shot Learningcited by 66
  14. 2022Disentangling Visual Embeddings for Attributes and Objectscited by 55
  15. 2022Siamese Contrastive Embedding Network for Compositional Zero-Shot Learningcited by 55
  16. 2021Independent Prototype Propagation for Zero-Shot Compositionalitycited by 42
  17. 2024ViGoR: Improving Visual Grounding of Large Vision Language Models with Fine-Grained Reward Modelingcited by 34
  18. 2023Learning Attention as Disentangler for Compositional Zero-shot Learningcited by 29
  19. 2023Learning Conditional Attributes for Compositional Zero-Shot Learningcited by 28
  20. 2023Troika: Multi-Path Cross-Modal Traction for Compositional Zero-Shot Learningcited by 27
  21. 2023Prompting Language-Informed Distribution for Compositional Zero-Shot Learningcited by 24
  22. 2021Relation-aware Compositional Zero-shot Learning for Attribute-Object Pair Recognitioncited by 19
  23. 2023Hierarchical Visual Primitive Experts for Compositional Zero-Shot Learningcited by 16
  24. 2025Learning Clustering-based Prototypes for Compositional Zero-shot Learningcited by 14

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Compositional Zero-shot Learning via Progressive Language-based Observations
  2. 2026From Model Patterns to Abstract Semantics in Compositional Zero-Shot Learning
  3. 2025EVA: Mixture-of-Experts Semantic Variant Alignment for Compositional Zero-Shot Learning
  4. 2024Unified Framework for Open-World Compositional Zero-shot Learning
  5. 2026FlowComposer: Composable Flows for Compositional Zero-Shot Learning
  6. 2023CAILA: Concept-Aware Intra-Layer Adapters for Compositional Zero-Shot Learning
  7. 2025Learning Visual Proxy for Compositional Zero-Shot Learning
  8. 2026Compositional Reasoning in Language Models under Reinforcement Learning Post-Training