mlsanityData to 7 Oct 2026

Correcting What You Cannot See: Credit Assignment for Perception Distillation in Multimodal Reasoners

arXiv 2607.28336 ↗First posted 30 Jul 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

On-policy distillation provides dense supervision for multimodal reasoners, but its trajectory-level reward cannot determine whether a failed answer arose from perception or subsequent reasoning. Perception Success Rate (PSR), estimated from multiple reasonings sharing one perception, remains ambiguous because low success conflates perceptual insufficiency with reasoning difficulty. We introduce Perception-Correction Distillation (PCD), a label-free method that identifies correctable perception failures using downstream failure and teacher--student disagreement as complementary witnesses. Their product, , forms a soft AND gate that strengthens distillation only when both witnesses are present. We motivate this rule through Bayesian evidence combination and show that multiplication is the unique normalized bilinear gate that vanishes when either witness is absent. PCD uses separated perception--reasoning rollouts and mean-preserving weights, leaving the reasoning objective unchanged. Across eight benchmarks, PCD improves the 8B 2B macro average from 44.50 with OPD to 47.28 and the 32B 8B result from 56.94 to 61.22. In matched 2B ablations, removing PCD and separated rollout reduces held-out average by 2.22 and 0.88 points, respectively. Effective multimodal distillation therefore depends not only on what the teacher predicts, but also on identifying when perception is the appropriate target of correction.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 41 references that are in the map. First posted on arXiv 30 Jul 2026.

Builds on

36 of 41 references.

References · 36

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2025Qwen2.5-VL Technical Reportcited by 5,418
  5. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  6. 2023Let's Verify Step by Stepcited by 3,598
  7. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  8. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
  9. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
  10. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 895
  11. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
  12. 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 840
24 more
  1. 2016Sequence-Level Knowledge Distillationcited by 761
  2. 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
  3. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 573
  4. 2018Born Again Neural Networkscited by 539
  5. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 516
  6. 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 494
  7. 2015Policy Distillationcited by 414
  8. 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 376
  9. 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?cited by 281
  10. 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoningcited by 267
  11. 2021Knowledge distillation: A good teacher is patient and consistentcited by 255
  12. 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contextscited by 240
  13. 2018RUDDER: Return Decomposition for Delayed Rewardscited by 162
  14. 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoningcited by 134
  15. 2019Distilling Policy Distillationcited by 81
  16. 2026Vision-OPD: Learning to See Fine Details for Multimodal LLMs via On-Policy Self-Distillationcited by 71
  17. 2024KAM-CoT: Knowledge Augmented Multimodal Chain-of-Thoughts Reasoningcited by 60
  18. 2023T-SciQ: Teaching Multimodal Chain-of-Thought Reasoning via Mixed Large Language Model Signals for Science Question Answeringcited by 59
  19. 2025Spotlight on Token Perception for Multimodal Reinforcement Learningcited by 37
  20. 2023Multi-modal Latent Space Learning for Chain-of-Thought Reasoning in Language Modelscited by 24
  21. 2024Latent Reward: LLM-Empowered Credit Assignment in Episodic Reinforcement Learningcited by 22
  22. 2024Multimodal Commonsense Knowledge Distillation for Visual Question Answeringcited by 11
  23. 2026What, Whether and How? Unveiling Process Reward Models for Thinking with Images Reasoningcited by 7
  24. 2025EM-KD: Distilling Efficient Multimodal Large Language Model with Unbalanced Vision Tokenscited by 4

Built on by

Not cited yet.