FaceCam: Portrait Video Camera Control via Scale-Aware Conditioning
Not on the map. Why?
Abstract (arXiv)
We introduce FaceCam, a system that generates video under customizable camera trajectories for monocular human portrait video input. Recent camera control approaches based on large video-generation models have shown promising progress but often exhibit geometric distortions and visual artifacts on portrait videos due to scale-ambiguous camera representations or 3D reconstruction errors. To overcome these limitations, we propose a face-tailored scale-aware representation for camera transformations that provides deterministic conditioning without relying on 3D priors. We train a video generation model on both multi-view studio captures and in-the-wild monocular videos, and introduce two camera-control data generation strategies: synthetic camera motion and multi-shot stitching, to exploit stationary training cameras while generalizing to dynamic, continuous camera trajectories at inference time. Experiments on Ava-256 dataset and diverse in-the-wild videos demonstrate that FaceCam achieves superior performance in camera controllability, visual quality, identity and motion preservation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 43 of its 60 references that are in the map. First posted on arXiv 5 Mar 2026.
Builds on
43 of 60 references.
References · 43
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
- 2022Kubric: A scalable dataset generatorcited by 381
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
- 2018Deep Video Portraitscited by 267
31 more
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 231
- 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
- 2021Neural Head Avatars from Monocular RGB Videoscited by 213
- 2024DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videoscited by 204
- 2024EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditionscited by 196
- 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 194
- 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 178
- 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 161
- 2022Instant Volumetric Head Avatarscited by 159
- 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
- 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
- 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 151
- 2025OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Modelscited by 129
- 2024Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformercited by 122
- 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 117
- 2024Loopy: Taming Audio-Driven Portrait Avatar with Long-Term Motion Dependencycited by 102
- 2025Controllable Video Generation: A Surveycited by 98
- 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modelingcited by 96
- 2024V-Express: Conditional Dropout for Progressive Training of Portrait Video Generationcited by 86
- 2025OmniAvatar: Efficient Audio-Driven Avatar Video Generation with Adaptive Body Animationcited by 83
- 2025Wan-Animate: Unified Character Animation and Replacement with Holistic Replicationcited by 80
- 2024NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizercited by 79
- 2024ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuningcited by 70
- 2025HunyuanVideo-Avatar: High-Fidelity Audio-Driven Human Animation for Multiple Characterscited by 69
- 2025Let Them Talk: Audio-Driven Multi-Person Conversational Video Generationcited by 66
- 2024Trajectory Attention for Fine-grained Video Motion Controlcited by 63
- 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 53
- 2025Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidancecited by 45
- 2024FATE: Full-head Gaussian Avatar with Textural Editing from Monocular Videocited by 32
- 2024FaceLift: Learning Generalizable Single Image 3D Face Reconstruction from Synthetic Headscited by 22
Built on by
Not cited yet.