mlsanityData to 14 Oct 2026

Scaling Video Generation for Reasoning: At What Cost?

arXiv 2609.36599 ↗First posted 29 Sep 2026cs.CV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We study whether scaling video generation enables models to reason about hidden information from the past frames, and at what computational cost. Our controlled benchmark requires predicting nine prescribed moves of an initially solved 2x2x2 Rubik's Cube from a fixed view of three faces. Correct predictions require inferring how actions change hidden states, and the simulator provides exact ground truth for evaluation. Models learn plausible cube geometry early, while correct sticker configurations require substantially more training. Although validation MSE follows approximate power-law scaling, lower MSE loss does not reliably indicate downstream reasoning capabilities. Smaller autoregressive models achieve higher state accuracy with limited compute, while larger models reach higher accuracy after more training. At roughly 0.1 PF-days, the 70M-parameter model correctly predicts the visible sticker configuration in 44.6% of post-action frames, compared with 0.3% for the 1B model, which reaches 83.7% at 3.14 PF-days. Symbolic state supervision raises the 20M model's frame accuracy from 31.1% to 67.3% at the same training-data budget, suggesting that learning representations of state changes can complement scaling.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 37 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

30 of 37 references.

References · 30

  1. 2020Scaling Laws for Neural Language Modelscited by 6,586
  2. 2022Scalable Diffusion Models with Transformerscited by 6,054
  3. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  5. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  6. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  7. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  8. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  9. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  10. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  11. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
  12. 2017Deep Learning Scaling is Predictable, Empiricallycited by 582
18 more
  1. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  2. 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 554
  3. 2026World Action Models are Zero-shot Policiescited by 465
  4. 2023Learning Interactive Real-World Simulatorscited by 458
  5. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
  6. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
  7. 2025World Simulation with Video Foundation Models for Physical AIcited by 200
  8. 2023Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Lawscited by 159
  9. 2025WorldModelBench: Judging Video Generation Models As World Modelscited by 124
  10. 2024Video as the New Language for Real-World Decision Makingcited by 87
  11. 2024Scaling Laws For Diffusion Transformerscited by 44
  12. 2026A Very Big Video Reasoning Suitecited by 34
  13. 2024Towards Precise Scaling Laws for Video Diffusion Transformerscited by 20
  14. 2026MBench: A Comprehensive Benchmark on Memory Capability for Video World Modelscited by 18
  15. 2026MemoBench: Benchmarking World Modeling in Dynamically Changing Environmentscited by 12
  16. 2026VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoningcited by 6
  17. 2026Can Video World Models Track Unobserved World States?cited by 2
  18. 2026Abra: Scaling Diffusion Image Trainingcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Thinking in Frames: How Visual Context and Test-Time Scaling Empower Video Reasoning
  2. 2025Are Video Models Ready as Zero-Shot Reasoners? An Empirical Study with the MME-CoF Benchmark
  3. 2025Reasoning via Video: The First Evaluation of Video Models' Reasoning Abilities through Maze-Solving Tasks
  4. 2025Video Models Start to Solve Chess, Maze, Sudoku, Mental Rotation, and Raven' Matrices
  5. 2025TiViBench: Benchmarking Think-in-Video Reasoning for Video Generative Models
  6. 2025RULER-Bench: Probing Rule-based Reasoning Abilities of Next-level Video Generation Models for Vision Foundation Intelligence
  7. 2026VGI-Bench: Probing Visual Intelligence in Video Generation Models
  8. 2025V-ReasonBench: Toward Unified Reasoning Benchmark Suite for Video Generation Models