Warp-as-History: Generalizable Camera-Controlled Video Generation from One Training Video
Not on the map. Why?
Abstract (arXiv)
Camera-controlled video generation has made substantial progress, enabling generated videos to follow prescribed viewpoint trajectories. However, existing methods usually learn camera-specific conditioning through camera encoders, control branches, or attention and positional-encoding modifications, which often require post-training on large-scale camera-annotated videos. Training-free alternatives avoid such post-training, but often shift the cost to test-time optimization or extra denoising-time guidance. We propose Warp-as-History, a simple interface that turns camera-induced warps into camera-warped pseudo-history with target-frame positional alignment and visible-token selection. Given a target camera trajectory, we construct camera-warped pseudo-history from past observations and feed it through the model's visual-history pathway. Crucially, we align its positional encoding with the target frames being denoised and remove warped-history tokens without valid source observations. Without any training, architectural modification, or test-time optimization, this interface reveals a non-trivial zero-shot capability of a frozen video generation model to follow camera trajectories. Moreover, lightweight offline LoRA finetuning on only one camera-annotated video further improves this capability and generalizes to unseen videos, improving camera adherence, visual quality, and motion dynamics without test-time optimization or target-video adaptation. Extensive experiments on diverse datasets confirm the effectiveness of our method.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 22 of its 26 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
22 of 26 references.
References · 22
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 341
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
- 2025History-Guided Video Diffusioncited by 171
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modelingcited by 170
- 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 163
10 more
- 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 156
- 2025Video World Models with Long-term Spatial Memorycited by 136
- 2024Training-free Camera Control for Video Generationcited by 122
- 2025Cameras as Relative Positional Encodingcited by 105
- 2025Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generationcited by 101
- 2024NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizercited by 79
- 2026Helios: Real Real-Time Long Video Generation Modelcited by 65
- 2025FantasyWorld: Geometry-Consistent World Modeling via Unified Video and 3D Predictioncited by 38
- 2025Unified Camera Positional Encoding for Controlled Video Generationcited by 37
- 2024Novel View Extrapolation with Video Diffusion Priorscited by 25
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Alaya-EVOKE: From Linear-Scaling Supervision to Endless Worldcited by 14
- 2026SCoPE: Sightline-Coordinate Positional Encoding for Video Diffusion Transformerscited by 5
- 2026HelloWorld: Enabling Socially Interactive Characters in Video World Modelscited by 1
- 2026World in World: Explore the World with World Modelscited by 0
- 2026World in World: Explore the World with World Models10 Sep 2026
- 2026Alaya-EVOKE: From Linear-Scaling Supervision to Endless World13 Aug 2026
- 2026HelloWorld: Enabling Socially Interactive Characters in Video World Models5 Aug 2026
- 2026SCoPE: Sightline-Coordinate Positional Encoding for Video Diffusion Transformers25 Jun 2026