mlsanityData to 14 Oct 2026

FaceCam: Portrait Video Camera Control via Scale-Aware Conditioning

arXiv 2603.05506 ↗First posted 5 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce FaceCam, a system that generates video under customizable camera trajectories for monocular human portrait video input. Recent camera control approaches based on large video-generation models have shown promising progress but often exhibit geometric distortions and visual artifacts on portrait videos due to scale-ambiguous camera representations or 3D reconstruction errors. To overcome these limitations, we propose a face-tailored scale-aware representation for camera transformations that provides deterministic conditioning without relying on 3D priors. We train a video generation model on both multi-view studio captures and in-the-wild monocular videos, and introduce two camera-control data generation strategies: synthetic camera motion and multi-shot stitching, to exploit stationary training cameras while generalizing to dynamic, continuous camera trajectories at inference time. Experiments on Ava-256 dataset and diverse in-the-wild videos demonstrate that FaceCam achieves superior performance in camera controllability, visual quality, identity and motion preservation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 43 of its 60 references that are in the map. First posted on arXiv 5 Mar 2026.

Builds on

43 of 60 references.

References · 43

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 2022Scalable Diffusion Models with Transformerscited by 6,054
  3. 2022Flow Matching for Generative Modelingcited by 5,702
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  5. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  6. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  7. 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
  8. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
  9. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
  10. 2022Kubric: A scalable dataset generatorcited by 381
  11. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
  12. 2018Deep Video Portraitscited by 267
31 more
  1. 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
  2. 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 231
  3. 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
  4. 2021Neural Head Avatars from Monocular RGB Videoscited by 213
  5. 2024DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videoscited by 204
  6. 2024EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditionscited by 196
  7. 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 194
  8. 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 178
  9. 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 161
  10. 2022Instant Volumetric Head Avatarscited by 159
  11. 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
  12. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
  13. 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 151
  14. 2025OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Modelscited by 129
  15. 2024Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformercited by 122
  16. 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 117
  17. 2024Loopy: Taming Audio-Driven Portrait Avatar with Long-Term Motion Dependencycited by 102
  18. 2025Controllable Video Generation: A Surveycited by 98
  19. 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modelingcited by 96
  20. 2024V-Express: Conditional Dropout for Progressive Training of Portrait Video Generationcited by 86
  21. 2025OmniAvatar: Efficient Audio-Driven Avatar Video Generation with Adaptive Body Animationcited by 83
  22. 2025Wan-Animate: Unified Character Animation and Replacement with Holistic Replicationcited by 80
  23. 2024NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizercited by 79
  24. 2024ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuningcited by 70
  25. 2025HunyuanVideo-Avatar: High-Fidelity Audio-Driven Human Animation for Multiple Characterscited by 69
  26. 2025Let Them Talk: Audio-Driven Multi-Person Conversational Video Generationcited by 66
  27. 2024Trajectory Attention for Fine-grained Video Motion Controlcited by 63
  28. 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 53
  29. 2025Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidancecited by 45
  30. 2024FATE: Full-head Gaussian Avatar with Textural Editing from Monocular Videocited by 32
  31. 2024FaceLift: Learning Generalizable Single Image 3D Face Reconstruction from Synthetic Headscited by 22

Built on by

Not cited yet.