Video Generation Models are General-Purpose Vision Learners
Not on the map. Why?
Abstract (arXiv)
Driven by next-token prediction, NLP shifted from task-specific models into powerful generalist foundation models. What, then, is the equivalent catalyst needed to achieve a general-purpose model in computer vision? In this paper, we contend that large-scale text-to-video generation serves as a strong pre-training paradigm for computer vision, providing the necessary spatiotemporal priors, vision-language alignment, and scalability required for general visual intelligence. We introduce GenCeption, which leverages a pre-trained video generative diffusion backbone to define a feed-forward perception model, capable of performing various vision tasks steered by text instructions. Empirical results demonstrate that GenCeption achieves state-of-the-art performance across a diverse suite of tasks, including depth, surface normal, and camera pose estimation, expression-referring segmentation, and 3D keypoint prediction, often matching or surpassing specialized models (e.g. DepthAnything3, SAM3, D4RT, VGGT-Omega, Sapiens, David, Genmo, and Lotus-2). Furthermore, the video generative pretrained backbone outperforms alternative pretraining paradigms (e.g., V-JEPA, and Video MAE) under comparable settings. Importantly, GenCeption exhibits preliminary data and model scaling properties along with exceptional data efficiency, where it achieves comparable performance with leading models like D4RT and VGGT-Omega with 7 to 500 less training data. Finally, GenCeption also exhibits intriguing emergent behaviors: a model trained exclusively on synthetic human videos generalizes to real-world footage and out-of-distribution object categories (e.g., animals and robots). These findings suggest that video generation is not merely a synthesis tool, but a foundational path toward generalist vision intelligence for the physical world. Project page: https://genception.github.io
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 74 of its 86 references that are in the map. First posted on arXiv 10 Jul 2026.
Builds on
74 of 86 references.
References · 74
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2023Segment Anythingcited by 8,158
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2022Flow Matching for Generative Modelingcited by 5,426
38 more
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,305
- 2025DINOv3cited by 1,297
- 2016Modeling Context in Referring Expressionscited by 1,054
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 721
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 490
- 2016Virtual Worlds as Proxy for Multi-Object Tracking Analysiscited by 340
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 323
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 283
- 2018DeepMVS: Learning Multi-view Stereopsiscited by 277
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2018YouTube-VOS: Sequence-to-Sequence Video Object Segmentationcited by 228
- 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 225
- 2025Video models are zero-shot learners and reasonerscited by 208
- 2024DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videoscited by 202
- 2022Language as Queries for Referring Video Object Segmentationcited by 180
- 2020Real-Time High-Resolution Background Mattingcited by 172
- 2018Video Object Segmentation with Language Referring Expressionscited by 161
- 2021Robust High-Resolution Video Matting with Temporal Guidancecited by 136
- 2024Cameras as Rays: Pose Estimation via Ray Diffusioncited by 129
- 2020MODNet: Real-Time Trimap-Free Portrait Matting via Objective Decompositioncited by 127
- 2024World-Grounded Human Motion Recovery via Gravity-View Coordinatescited by 127
- 2021Uni-Perceiver: Pre-training Unified Architecture for Generic Perception for Zero-shot and Few-shot Taskscited by 124
- 2024VISA: Reasoning Video Object Segmentation via Large Language Modelscited by 123
- 20234M: Massively Multimodal Masked Modelingcited by 118
50 most cited of 74 All 74 (JSON)
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026Magpie: Real-Time World Renderer for Interactive Gamescited by 3
- 2026VGI-Bench: Probing Visual Intelligence in Video Generation Modelscited by 2
- 2026Uncovering Understanding-Generation Synergy in Native Unified Multimodal Models: From Representation, Task to Systemcited by 2
- 2026ACE-Ego-Hand: Repurposing Video Diffusion Models for Occlusion-Robust Egocentric 3D Hand Motion Recoverycited by 1
- 2026MachEmbodied-U0: Unified Understanding and Generation Model for Embodied Intelligencecited by 1
- 2026SUV: Future Scene Understanding as Video Generation for End-to-End Drivingcited by 0
- 2026Beyond Pixels: From Video Priors to 4D Worldscited by 0
- 2026Diffuse2Seg: Diffusion Models Can Segment Anything Without Supervisioncited by 0
- 2026Generalist Open-World Temporal Perceptioncited by 0
- 2026Latent evolving World Action Modelcited by 0
- 2026Learning via Self-Consistency for Diffusion-based Video Reasoningcited by 0
- 2026Emergent Multi-View Geometry Through Self-Distillationcited by 0
- 2026Emergent Multi-View Geometry Through Self-Distillation30 Sep 2026
- 2026Learning via Self-Consistency for Diffusion-based Video Reasoning29 Sep 2026
- 2026Latent evolving World Action Model23 Sep 2026
- 2026MachEmbodied-U0: Unified Understanding and Generation Model for Embodied Intelligence22 Sep 2026
- 2026Generalist Open-World Temporal Perception6 Sep 2026
- 2026Diffuse2Seg: Diffusion Models Can Segment Anything Without Supervision6 Sep 2026
- 2026Uncovering Understanding-Generation Synergy in Native Unified Multimodal Models: From Representation, Task to System1 Sep 2026
- 2026Magpie: Real-Time World Renderer for Interactive Games27 Aug 2026
- 2026ACE-Ego-Hand: Repurposing Video Diffusion Models for Occlusion-Robust Egocentric 3D Hand Motion Recovery20 Aug 2026
- 2026VGI-Bench: Probing Visual Intelligence in Video Generation Models20 Aug 2026
- 2026Beyond Pixels: From Video Priors to 4D Worlds11 Aug 2026
- 2026SUV: Future Scene Understanding as Video Generation for End-to-End Driving4 Aug 2026