RealCam: Real-Time Novel-View Video Generation with Interactive Camera Control
Not on the map. Why?
Abstract (arXiv)
Camera-controlled video-to-video (V2V) generation enables dynamic viewpoint synthesis from monocular footage, holding immense potential for interactive filmmaking and live broadcasting. However, existing implicit synthesis methods fundamentally rely on non-causal, full-sequence processing and rigid prefix-style temporal concatenation. This architectural paradigm mandates bidirectional attention, resulting in prohibitive computational latency, quadratic complexity scaling, and inherent incompatibility with real-time streaming or variable-length inputs. To overcome these limitations, we introduce textttRealCam, a novel autoregressive framework for interactive, real-time camera-controlled V2V generation. We first design a high-fidelity teacher model grounded in a Cross-frame In-context Learning paradigm. By interleaving source and target frames into synchronized contextual pairs, our design inherently enables length-agnostic generalization and naturally facilitates causal adaptation, breaking the rigid prefix bottleneck. We then distill this teacher into a few-step causal student via Self-Forcing with Distribution Matching Distillation, enabling efficient, on-the-fly streaming synthesis. Furthermore, to mitigate severe loop inconsistency in closed-loop trajectories, we propose Loop-Closed Data Augmentation (LoopAug), a novel paradigm that synthesizes globally consistent loop sequences from existing multiview datasets. Extensive experiments demonstrate that textttRealCam achieves state-of-the-art visual fidelity and temporal consistency while enabling truly interactive camera control with orders-of-magnitude faster inference than existing paradigms. Our project page is at https://xyc-fly.github.io/RealCam/.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 26 of its 57 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
26 of 57 references.
References · 26
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 276
- 2025LongLive: Real-time Interactive Long Video Generationcited by 265
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Timecited by 234
- 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 170
- 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 166
- 2024Training-free Camera Control for Video Generationcited by 122
- 2024MotionClone: Training-Free Motion Cloning for Controllable Video Generationcited by 105
14 more
- 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 98
- 2025Controllable Video Generation: A Surveycited by 98
- 2025Infinity-RoPE: Action-Controllable Infinite Video Generation Emerges From Autoregressive Self-Rolloutcited by 86
- 2025Deep Forcing: Training-Free Long Video Generation with Deep Sink and Participative Compressioncited by 85
- 2025Yume: An Interactive World Generation Modelcited by 81
- 2025MotionStream: Real-Time Video Generation with Interactive Motion Controlscited by 76
- 2024I2VControl-Camera: Precise Video Camera Control with Adjustable Motion Strengthcited by 39
- 2026OmniForcing: Unleashing Real-time Joint Audio-Visual Generationcited by 16
- 2025See4D: Pose-Free 4D Generation via Auto-Regressive Video Inpaintingcited by 12
- 2025ReDirector: Creating Any-Length Video Retakes with Rotary Camera Encodingcited by 11
- 2025Real-Time Motion-Controllable Autoregressive Video Diffusioncited by 9
- 2025PersonaLive! Expressive Portrait Image Animation for Live Streamingcited by 9
- 2025LiveTalk: Real-Time Multimodal Interactive Video Diffusion via Improved On-Policy Distillationcited by 9
- 2025EgoEdit: Dataset, Real-Time Streaming Model, and Benchmark for Egocentric Video Editingcited by 8
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesis
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation
- 2025RealCam-I2V: Real-World Image-to-Video Generation with Interactive Complex Camera Control
- 2025CamC2V: Context-aware Controllable Video Generation
- 2026AnyView: Synthesizing Any Novel View in Dynamic Scenes
- 2026EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editing
- 2025VideoSSM: Autoregressive Long Video Generation with Hybrid State-Space Memory
- 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generation