mlsanityData to 14 Oct 2026

OWLET: On-Policy Weighted Learning via Evidence Transfer for Video Large Language Model Post-Training

arXiv 2610.13272 ↗First posted 9 Oct 2026cs.CVcited by 0

On the map: LLM reasoning → Multimodal reasoning also fits: Reinforcement learning for reasoning

Abstract (arXiv)

Post-training has become a key stage for eliciting reasoning capabilities in Video Large Language Models (Video-LLMs). Existing post-training methods mainly follow two paradigms: reinforcement learning (RL) and on-policy distillation (OPD). However, they do not fully exploit visual evidence for effective training. RL supervises the policy with a single trajectory-level reward, which is too coarse-grained for video reasoning: the same response-level advantage is applied to every generated token, disregarding that the tokens of a video response are grounded in the visual stream to very different degrees. OPD provides token-level supervision through output-distribution matching, but lacks direct supervision of the spatiotemporal representations that produce those outputs. We observe across extensive experiments that the same model reasons more accurately when its video view combines global temporal context with question-relevant details. Comparing the same student-generated response under this view and uniform sampling reveals changes in token likelihoods and internal representations, providing a training signal for evidence use. Building on this observation, we propose OWLET, an evidence-privileged RL method that derives training signals from a richer teacher view. This view couples uniform global context with question-conditioned local windows, providing visual evidence without requiring a larger model. To better exploit this privileged visual evidence, OWLET introduces (i) evidence-aware credit redistribution, which compares token likelihoods across the two views and redistributes positive response-level advantages according to their relative evidence support; and (ii) spatiotemporal state alignment, which aligns the two views' hidden states on verifier-accepted responses.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. First posted on arXiv 9 Oct 2026.

Builds on

0 of 0 references.

No references here yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Video-OPSD: Exploiting Privileged Visual Evidence for On-Policy Self-Distillation in Video Large Language Models
  2. 2025Exploring the Effect of Reinforcement Learning on Video Understanding: Insights from SEED-Bench-R1
  3. 2026Video-OPD: Efficient Post-Training of Multimodal Large Language Models for Temporal Video Grounding via On-Policy Distillation
  4. 2026Deep Thought Alignment: Trajectory-Level Latent Distillation for Video Reasoning
  5. 2025Video-RTS: Rethinking Reinforcement Learning and Test-Time Scaling for Efficient and Enhanced Video Reasoning
  6. 2026MeSD: Multi-Evidence Self-Distillation for VideoLLM
  7. 2026Find, Fix, Reason: Context Repair for Video Reasoning
  8. 2026Frame Differential On-Policy Self-Distillation for Video Reasoning