mlsanityData to 14 Oct 2026

DuoTeach: Dual Role Self-Teaching for Coarse-to-Fine Decision Coordination in Vision--Language Models

arXiv 2511.18415 ↗First posted 23 Nov 2025cs.MM cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Coarse-to-fine path decision-making requires predicting a valid taxonomy path in which earlier decisions constrain later ones. However, existing benchmarks score each level independently, obscuring cross-level validity and consistency. To better align evaluation with this setting, we introduce a Joint Path Decision (JPD) protocol that requires predicting the full path in one call, together with Depth-Weighted Prefix Accuracy (DWPA), a metric family that measures path reliability with tunable emphasis on deeper levels. Under JPD, strong vision-language models (VLMs) frequently produce invalid parent-child pairs and brittle full-path predictions, suggesting that their failures stem not only from incomplete taxonomic knowledge but also from unstable cross-level decision coordination. To address this problem, we propose DuoTeach, a dual-role self-teaching distillation framework that requires no ground-truth labels and reuses the same pretrained VLM in two roles. Its Decision-Conditioned Rollout (DCR) generates more coherent teacher traces by conditioning each level on prior decisions, and distills this coordinated behavior into the student without additional test-time rollouts. Across multiple taxonomy-structured benchmarks and VLM base models, DuoTeach improves in-domain DWPA (alpha = 0.95) by up to 30.24 points and boosts zero-shot performance on unseen taxonomies from 17.17% to 43.66%. Further analyses attribute these gains to improved within-call multi-level decision coordination.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 30 references that are in the map. First posted on arXiv 23 Nov 2025.

Builds on

18 of 30 references.

References · 18

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  3. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
  4. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
  5. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  6. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
  7. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  8. 2018Born Again Neural Networkscited by 546
  9. 2019Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillationcited by 497
  10. 2021Benchmarking Representation Learning for Natural World Image Collectionscited by 168
  11. 2020Self-Distillation as Instance-Specific Label Smoothingcited by 71
  12. 2023Visual Program Distillation: Distilling Tools and Programmatic Reasoning into Vision-Language Modelscited by 66
6 more
  1. 2024Enhancing Video-LLM Reasoning via Agent-of-Thoughts Distillationcited by 37
  2. 2022Exploring Hierarchical Graph Representation for Large-Scale Zero-Shot Image Classificationcited by 21
  3. 2025ToolVQA: A Dataset for Multi-step Reasoning VQA with External Toolscited by 13
  4. 2023Hyperbolic Space with Hierarchical Margin Boosts Fine-Grained Learning from Coarse Labelscited by 8
  5. 2025The LLM Bottleneck: Why Open-Source Vision LLMs Struggle with Hierarchical Visual Recognitioncited by 7
  6. 2025Towards Trustworthy Multimodal Moderation via Policy-Aligned Reasoning and Hierarchical Labelingcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Unveiling Chain of Step Reasoning for Vision-Language Models with Fine-grained Rewards
  2. 2026ComplexityWorld: Benchmarking Vision-Language Models on Verifiable Visual Decision Making
  3. 2026Distill What the Student Can See: Fisher-Projected On-Policy Distillation for Vision-Language Models
  4. 2026DuoOPD: Learning from Joint Teacher-Student Outcomes for Multi-Task On-Policy Distillation
  5. 2026TTRSD: Test-Time Reinforcement Learning with Self-Distillation for Vision-Language Models
  6. 2026Do As I Do, Not As I Say: On-Policy Distillation Inherits the Teacher in Vision-Language Models
  7. 2026OPSRD: On-Policy Self-Role Distillation
  8. 2025Knowing the Answer Isn't Enough: Fixing Reasoning Path Failures in LVLMs