Correcting What You Cannot See: Credit Assignment for Perception Distillation in Multimodal Reasoners
Not on the map. Why?
Abstract (arXiv)
On-policy distillation provides dense supervision for multimodal reasoners, but its trajectory-level reward cannot determine whether a failed answer arose from perception or subsequent reasoning. Perception Success Rate (PSR), estimated from multiple reasonings sharing one perception, remains ambiguous because low success conflates perceptual insufficiency with reasoning difficulty. We introduce Perception-Correction Distillation (PCD), a label-free method that identifies correctable perception failures using downstream failure and teacher--student disagreement as complementary witnesses. Their product, , forms a soft AND gate that strengthens distillation only when both witnesses are present. We motivate this rule through Bayesian evidence combination and show that multiplication is the unique normalized bilinear gate that vanishes when either witness is absent. PCD uses separated perception--reasoning rollouts and mean-preserving weights, leaving the reasoning objective unchanged. Across eight benchmarks, PCD improves the 8B 2B macro average from 44.50 with OPD to 47.28 and the 32B 8B result from 56.94 to 61.22. In matched 2B ablations, removing PCD and separated rollout reduces held-out average by 2.22 and 0.88 points, respectively. Effective multimodal distillation therefore depends not only on what the teacher predicts, but also on identifying when perception is the appropriate target of correction.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 41 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
36 of 41 references.
References · 36
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2023Let's Verify Step by Stepcited by 3,598
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 895
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
- 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 840
24 more
- 2016Sequence-Level Knowledge Distillationcited by 761
- 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 573
- 2018Born Again Neural Networkscited by 539
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 516
- 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 494
- 2015Policy Distillationcited by 414
- 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 376
- 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?cited by 281
- 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoningcited by 267
- 2021Knowledge distillation: A good teacher is patient and consistentcited by 255
- 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contextscited by 240
- 2018RUDDER: Return Decomposition for Delayed Rewardscited by 162
- 2025VisualPRM: An Effective Process Reward Model for Multimodal Reasoningcited by 134
- 2019Distilling Policy Distillationcited by 81
- 2026Vision-OPD: Learning to See Fine Details for Multimodal LLMs via On-Policy Self-Distillationcited by 71
- 2024KAM-CoT: Knowledge Augmented Multimodal Chain-of-Thoughts Reasoningcited by 60
- 2023T-SciQ: Teaching Multimodal Chain-of-Thought Reasoning via Mixed Large Language Model Signals for Science Question Answeringcited by 59
- 2025Spotlight on Token Perception for Multimodal Reinforcement Learningcited by 37
- 2023Multi-modal Latent Space Learning for Chain-of-Thought Reasoning in Language Modelscited by 24
- 2024Latent Reward: LLM-Empowered Credit Assignment in Episodic Reinforcement Learningcited by 22
- 2024Multimodal Commonsense Knowledge Distillation for Visual Question Answeringcited by 11
- 2026What, Whether and How? Unveiling Process Reward Models for Thinking with Images Reasoningcited by 7
- 2025EM-KD: Distilling Efficient Multimodal Large Language Model with Unbalanced Vision Tokenscited by 4
Built on by
Not cited yet.