mlsanityData to 7 Oct 2026

CoTZero: Annotation-Free Human-Like Vision Reasoning via Hierarchical Synthetic CoT

arXiv 2602.08339 ↗First posted 9 Feb 2026cs.AI cs.CVcited by 0

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Recent advances in vision-language models (VLMs) have markedly improved image-text alignment, yet they still fall short of human-like visual reasoning. A key limitation is that many VLMs rely on surface correlations rather than building logically coherent structured representations, which often leads to missed higher-level semantic structure and non-causal relational understanding, hindering compositional and verifiable reasoning. To address these limitations by introducing human models into the reasoning process, we propose CoTZero, an annotation-free paradigm with two components: (i) a dual-stage data synthesis approach and (ii) a cognition-aligned training method. In the first component, we draw inspiration from neurocognitive accounts of compositional productivity and global-to-local analysis. In the bottom-up stage, CoTZero extracts atomic visual primitives and incrementally composes them into diverse, structured question-reasoning forms. In the top-down stage, it enforces hierarchical reasoning by using coarse global structure to guide the interpretation of local details and causal relations. In the cognition-aligned training component, built on the synthesized CoT data, we introduce Cognitively Coherent Verifiable Rewards (CCVR) in Reinforcement Fine-Tuning (RFT) to further strengthen VLMs' hierarchical reasoning and generalization, providing stepwise feedback on reasoning coherence and factual correctness. Experiments show that CoTZero achieves an F1 score of 83.33 percent on our multi-level semantic inconsistency benchmark with lexical-perturbation negatives, across both in-domain and out-of-domain settings. Ablations confirm that each component contributes to more interpretable and human-aligned visual reasoning.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 30 of its 50 references that are in the map. First posted on arXiv 9 Feb 2026.

Builds on

30 of 50 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025From Perception to Cognition: A Survey of Vision-Language Interactive Reasoning in Multimodal Large Language Models29 Sep
  2. 2025Look-Back: Implicit Visual Re-focusing in MLLM Reasoning2 Jul
  3. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontiers30 Jun
  4. 2025Why Vision Language Models Struggle with Visual Arithmetic? Towards Enhanced Chart and Geometry Understanding17 Feb
  5. 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMs10 Jan
  6. 2024Interleaved-Modal Chain-of-Thought29 Nov
  7. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
  8. 2024CogCoM: A Visual Language Model with Chain-of-Manipulations Reasoning6 Feb
  9. 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb
  10. 2022Visual Programming: Compositional visual reasoning without training18 Nov

Other references · 20

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  5. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  6. 2025Qwen3-VL Technical Reportcited by 2,534
  7. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  8. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 895
  9. 2025Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language Modelscited by 291
  10. 2024ReFT: Reasoning with Reinforced Fine-Tuningcited by 236
  11. 2024VinePPO: Refining Credit Assignment in RL Training of LLMscited by 168
  12. 2024Tarsier: Recipes for Training and Evaluating Large Video Description Modelscited by 140
8 more
  1. 2024VL-RewardBench: A Challenging Benchmark for Vision-Language Generative Reward Modelscited by 85
  2. 2024Benchmarking and Improving Detail Image Captioncited by 81
  3. 2023Improving Automatic VQA Evaluation Using Large Language Modelscited by 37
  4. 2024Self-Explore: Enhancing Mathematical Reasoning in Language Models with Fine-grained Rewardscited by 31
  5. 2024CosmicMan: A Text-to-Image Foundation Model for Humanscited by 30
  6. 2024Benchmarking Large Vision-Language Models via Directed Scene Graph for Comprehensive Image Captioningcited by 30
  7. 2016Building Machines That Learn and Think Like Peoplecited by 3
  8. 2023Mind the Gap: Improving Success Rate of Vision-and-Language Navigation by Revisiting Oracle Success Routescited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models
  2. 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoning
  3. 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Vision
  4. 2026ReGuLaR: Relation-Grounded Latent Reasoning for Large Vision-Language Models
  5. 2026VG-CoT: Towards Trustworthy Visual Reasoning via Grounded Chain-of-Thought
  6. 2026Improving Reasoning in Vision-Language Models via Perception Verified Self-Training
  7. 2025Integrating Chain-of-Thought for Multimodal Alignment: A Study on 3D Vision-Language Learning
  8. 2025Visual CoT Makes VLMs Smarter but More Fragile