Are Video Reasoning Models Ready to Go Outside?
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
In real-world deployment, vision-language models often encounter disturbances such as weather, occlusion, and camera motion. Under such conditions, their understanding and reasoning degrade substantially, revealing a gap between clean, controlled (i.e., unperturbed) evaluation settings and real-world robustness. To address this limitation, we propose ROVA, a novel training framework that improves robustness by modeling a robustness-aware consistency reward under spatio-temporal corruptions. ROVA introduces a difficulty-aware online training strategy that prioritizes informative samples based on the model's evolving capability. Specifically, it continuously re-estimates sample difficulty via self-reflective evaluation, enabling adaptive training with a robustness-aware consistency reward. We also introduce PVRBench, a new benchmark that injects real-world perturbations into embodied video datasets to assess both accuracy and reasoning quality under realistic disturbances. We evaluate ROVA and baselines on PVRBench, UrbanVideo, and VisBench, where open-source and proprietary models suffer up to 35% and 28% drops in accuracy and reasoning under realistic perturbations. ROVA effectively mitigates performance degradation, boosting relative accuracy by at least 24% and reasoning by over 9% compared with baseline models (QWen2.5/3-VL, InternVL2.5, Embodied-R). These gains transfer to clean standard benchmarks, yielding consistent improvements.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 43 of its 47 references that are in the map. First posted on arXiv 11 Mar 2026.
Builds on
43 of 47 references.
Closest ancestors · 5
Same direction, newest first
- 2025WorldMM: Dynamic Multimodal Memory Agent for Long Video Reasoning2 Dec
- 2025Video-RTS: Rethinking Reinforcement Learning and Test-Time Scaling for Efficient and Enhanced Video Reasoning9 Jul
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
- 2024CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion8 Feb
- 2024Benchmarking Large Multimodal Models against Common Corruptions22 Jan
Other references · 38
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2024GPT-4o System Cardcited by 4,467
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
- 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,304
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
- 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 580
- 2023On Evaluating Adversarial Robustness of Large Vision-Language Modelscited by 281
26 more
- 2024Video-XL: Extra-Long Vision Language Model for Hour-Scale Video Understandingcited by 210
- 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 190
- 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 159
- 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 138
- 2026Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Groundingcited by 132
- 2022Understanding Zero-Shot Adversarial Robustness for Large-Scale Modelscited by 117
- 2025Tarsier2: Advancing Large Vision-Language Models from Detailed Video Description to Comprehensive Video Understandingcited by 80
- 2025ReAgent-V: A Reward-Driven Multi-Agent Framework for Video Understandingcited by 50
- 2025Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Taskscited by 43
- 2023Test-Time Adaptation with CLIP Reward for Zero-Shot Generalization in Vision-Language Modelscited by 37
- 2024Video-Language Understanding: A Survey from Model Architecture, Model Training, and Data Perspectivescited by 37
- 2025Embodied-R: Collaborative Framework for Activating Embodied Spatial Reasoning in Foundation Models via Reinforcement Learningcited by 37
- 2025UrbanVideo-Bench: Benchmarking Vision-Language Models on Embodied Intelligence with Video Data in Urban Spacescited by 33
- 2025R-TPT: Improving Adversarial Robustness of Vision-Language Models through Test-Time Prompt Tuningcited by 33
- 2024Revisiting the Adversarial Robustness of Vision Language Models: a Multimodal Perspectivecited by 28
- 2022Robustness Analysis of Video-Language Models Against Visual and Language Perturbationscited by 23
- 2025Datasets and Recipes for Video Temporal Grounding via Reinforcement Learningcited by 18
- 2025Understanding Multimodal LLMs Under Distribution Shifts: An Information-Theoretic Approachcited by 15
- 2024Benchmarking the Robustness of Temporal Action Detection Models Against Temporal Corruptionscited by 12
- 2025Exploring Embodied Multimodal Large Models: Development, Datasets, and Future Directionscited by 12
- 2026When and How Much to Imagine: Adaptive Test-Time Scaling with World Models for Visual Spatial Reasoningcited by 12
- 2024MVTamperBench: Evaluating Robustness of Vision-Language Modelscited by 11
- 2023CLAP: Isolating Content from Style through Contrastive Learning with Augmented Promptscited by 10
- 2023Improve Video Representation with Temporal Adversarial Augmentationcited by 3
- 2025Pay Attention to Real World Perturbations! Natural Robustness Evaluation in Machine Reading Comprehensioncited by 2
- 2025RO-Bench: Large-scale robustness evaluation of MLLMs with text-driven counterfactual videoscited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Open-o3-Video: Grounded Video Reasoning with Explicit Spatio-Temporal Evidence
- 2025TiViBench: Benchmarking Think-in-Video Reasoning for Video Generative Models
- 2026A Very Big Video Reasoning Suite
- 2025Video-LMM Post-Training: A Deep Dive into Video Reasoning with Large Multimodal Models
- 2026RoVLA: Multi-Consistency Constraints for Robust Vision-Language-Action Models
- 2024Black Swan: Abductive and Defeasible Video Reasoning in Unpredictable Events
- 2026m2sv: A Scalable Benchmark for Map-to-Street-View Spatial Reasoning
- 2026SYNCR: Diagnosing and Learning Cross-Video Reasoning from Simulation