ID-V2V: Identity-Preserving Video Restylization
Not on the map. Why?
Abstract (arXiv)
In visual storytelling, human performances are central to creative intent and narrative meaning. However, preserving human identity and performance while enabling flexible visual edits remains challenging for generative video models. We formalize this challenge as identity-preserving video restylization, which propagates scene, lighting, and style changes specified by an edited keyframe across a source video, while preserving facial likeness and performance, including expressions, eye gaze, and lip synchronization. A key obstacle is the absence of paired training data, as identity-preserving restylized video pairs are rare in real-world settings. To address this, we propose a decoupling of source-grounded identity preservation and edit-driven video synthesis. Our key insight is that facial appearance and expression should remain invariant, with illumination being the primary permissible variation. We therefore cast identity preservation as a video relighting problem, while modeling visual edit propagation as controlled video synthesis guided by the edited keyframe. Building on this formulation, we introduce ID-V2V, a video-to-video generative framework integrating complementary control signals: relit facial regions and facial normal maps tightly constrain facial likeness and performance, while edited keyframes and depth sequences enable flexible and temporally coherent generation. This design enables constructing training pairs from a single video, eliminating the need for scarce paired data. Extensive experiments demonstrate that ID-V2V significantly outperforms existing methods in preserving facial likeness and fine-grained facial performance, supports both single- and multi-subject scenarios, and delivers high visual quality, highlighting its potential as a human-centric tool for real-world content production. The code is available at: https://github.com/Eyeline-Labs/ID-V2V.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 55 references that are in the map. First posted on arXiv 24 Jul 2026.
Builds on
36 of 55 references.
References · 36
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2025Qwen-Image Technical Reportcited by 973
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2022AdaFace: Quality Adaptive Margin for Face Recognitioncited by 390
24 more
- 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 254
- 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 213
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 122
- 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noisecited by 114
- 2021Sample and Computation Redistribution for Efficient Face Detectioncited by 86
- 2025Wan-Animate: Unified Character Animation and Replacement with Holistic Replicationcited by 76
- 2023Relightful Harmonization: Lighting-aware Portrait Background Replacementcited by 56
- 2016Artistic style transfer for videoscited by 54
- 2025HuMo: Human-Centric Video Generation via Collaborative Multi-Modal Conditioningcited by 44
- 2024ConsistentID: Portrait Generation with Multimodal Fine-Grained Identity Preservingcited by 42
- 2025Light-A-Video: Training-free Video Relighting via Progressive Light Fusioncited by 38
- 2024DifFRelight: Diffusion-Based Facial Performance Relightingcited by 35
- 2024Holo-Relighting: Controllable Volumetric Portrait Relighting from a Single Imagecited by 32
- 2025MagicMirror: ID-Preserved Video Generation in Video Diffusion Transformerscited by 32
- 2025RelightVid: Temporal-Consistent Diffusion Model for Video Relightingcited by 28
- 2025Lux Post Facto: Learning Portrait Performance Relighting with Conditional Video Diffusion and a Hybrid Datasetcited by 28
- 2023DiFaReli++: Diffusion Face Relighting with Consistent Cast Shadowscited by 14
- 2025Lumen: Consistent Video Relighting and Harmonious Background Replacement with Video Generative Modelscited by 11
- 2025Light-X: Generative 4D Video Rendering with Camera and Illumination Controlcited by 11
- 2025SteadyDancer: Harmonized and Coherent Human Image Animation with First-Frame Preservationcited by 10
- 2025RelightMaster: Precise Video Relighting with Multi-plane Light Imagescited by 8
- 2025Identity-Preserving Image-to-Video Generation via Reward-Guided Optimizationcited by 7
- 2025IP-FaceDiff: Identity-Preserving Facial Video Editing with Diffusioncited by 3
- 2024StructuReiser: A Structure-preserving Video Stylization Methodcited by 2
Built on by
Not cited yet.