mlsanityData to 7 Oct 2026

Video Generation Models are General-Purpose Vision Learners

arXiv 2607.09024 ↗First posted 10 Jul 2026cs.CV cs.AIcited by 12

Not on the map. Why?

Abstract (arXiv)

Driven by next-token prediction, NLP shifted from task-specific models into powerful generalist foundation models. What, then, is the equivalent catalyst needed to achieve a general-purpose model in computer vision? In this paper, we contend that large-scale text-to-video generation serves as a strong pre-training paradigm for computer vision, providing the necessary spatiotemporal priors, vision-language alignment, and scalability required for general visual intelligence. We introduce GenCeption, which leverages a pre-trained video generative diffusion backbone to define a feed-forward perception model, capable of performing various vision tasks steered by text instructions. Empirical results demonstrate that GenCeption achieves state-of-the-art performance across a diverse suite of tasks, including depth, surface normal, and camera pose estimation, expression-referring segmentation, and 3D keypoint prediction, often matching or surpassing specialized models (e.g. DepthAnything3, SAM3, D4RT, VGGT-Omega, Sapiens, David, Genmo, and Lotus-2). Furthermore, the video generative pretrained backbone outperforms alternative pretraining paradigms (e.g., V-JEPA, and Video MAE) under comparable settings. Importantly, GenCeption exhibits preliminary data and model scaling properties along with exceptional data efficiency, where it achieves comparable performance with leading models like D4RT and VGGT-Omega with 7 to 500 less training data. Finally, GenCeption also exhibits intriguing emergent behaviors: a model trained exclusively on synthetic human videos generalizes to real-world footage and out-of-distribution object categories (e.g., animals and robots). These findings suggest that video generation is not merely a synthesis tool, but a foundational path toward generalist vision intelligence for the physical world. Project page: https://genception.github.io

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 74 of its 86 references that are in the map. First posted on arXiv 10 Jul 2026.

Builds on

74 of 86 references.

References · 74

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020Language Models are Few-Shot Learnerscited by 32,199
  5. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  7. 2020Denoising Diffusion Implicit Modelscited by 9,655
  8. 2023Segment Anythingcited by 8,158
  9. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  10. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  11. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  12. 2022Flow Matching for Generative Modelingcited by 5,426
38 more
  1. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  2. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  3. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  4. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  6. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  7. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  8. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
  9. 2024Depth Anything V2cited by 1,385
  10. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  11. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,305
  12. 2025DINOv3cited by 1,297
  13. 2016Modeling Context in Referring Expressionscited by 1,054
  14. 2025SAM 3: Segment Anything with Conceptscited by 835
  15. 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 721
  16. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  17. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
  18. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 490
  19. 2016Virtual Worlds as Proxy for Multi-Object Tracking Analysiscited by 340
  20. 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 323
  21. 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
  22. 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 283
  23. 2018DeepMVS: Learning Multi-view Stereopsiscited by 277
  24. 2024Sapiens: Foundation for Human Vision Modelscited by 229
  25. 2018YouTube-VOS: Sequence-to-Sequence Video Object Segmentationcited by 228
  26. 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 225
  27. 2025Video models are zero-shot learners and reasonerscited by 208
  28. 2024DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videoscited by 202
  29. 2022Language as Queries for Referring Video Object Segmentationcited by 180
  30. 2020Real-Time High-Resolution Background Mattingcited by 172
  31. 2018Video Object Segmentation with Language Referring Expressionscited by 161
  32. 2021Robust High-Resolution Video Matting with Temporal Guidancecited by 136
  33. 2024Cameras as Rays: Pose Estimation via Ray Diffusioncited by 129
  34. 2020MODNet: Real-Time Trimap-Free Portrait Matting via Objective Decompositioncited by 127
  35. 2024World-Grounded Human Motion Recovery via Gravity-View Coordinatescited by 127
  36. 2021Uni-Perceiver: Pre-training Unified Architecture for Generic Perception for Zero-shot and Few-shot Taskscited by 124
  37. 2024VISA: Reasoning Video Object Segmentation via Large Language Modelscited by 123
  38. 20234M: Massively Multimodal Masked Modelingcited by 118

50 most cited of 74 All 74 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 12.

12 papers.