In-Context Sync-LoRA for Portrait Video Editing
Not on the map. Why?
Abstract (arXiv)
Editing portrait videos is a challenging task that requires flexible yet precise control over a wide range of modifications, such as appearance changes, expression edits, or the addition of objects. The key difficulty lies in preserving the subject's original temporal behavior, demanding that every edited frame remains precisely synchronized with the corresponding source frame. We present Sync-LoRA, a method for editing portrait videos that achieves high-quality visual modifications while maintaining frame-accurate synchronization and identity consistency. Our approach uses an image-to-video diffusion model, where the edit is defined by modifying the first frame and then propagated to the entire sequence. To enable accurate synchronization, we train an in-context LoRA using paired videos that depict identical motion trajectories but differ in appearance. These pairs are automatically generated and curated through a synchronization-based filtering process that selects only the most temporally aligned examples for training. This training setup teaches the model to combine motion cues from the source video with the visual changes introduced in the edited first frame. Trained on a compact, highly curated set of synchronized human portraits, Sync-LoRA generalizes to unseen identities and diverse edits (e.g., modifying appearance, adding objects, or changing backgrounds), robustly handling variations in pose and expression. Our results demonstrate high visual fidelity and strong temporal coherence, achieving a robust balance between edit fidelity and precise motion preservation.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 49 of its 61 references that are in the map. First posted on arXiv 2 Dec 2025.
Builds on
49 of 61 references.
References · 49
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
- 2020First Order Motion Model for Image Animationcited by 698
- 2023Zero-shot Image-to-Image Translationcited by 503
- 2025VACE: All-in-One Video Creation and Editingcited by 467
37 more
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
- 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 438
- 2023Pix2Video: Video Editing using Image Diffusioncited by 318
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
- 2020StyleRig: Rigging StyleGAN for 3D Control over Portrait Imagescited by 267
- 2023Style Aligned Image Generation via Shared Attentioncited by 214
- 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 214
- 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 202
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
- 2024AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animationcited by 191
- 2023Dreamix: Video Diffusion Models are General Video Editorscited by 189
- 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 172
- 2024In-Context LoRA for Diffusion Transformerscited by 155
- 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 151
- 2024ReNoise: Real Image Inversion Through Iterative Noisingcited by 127
- 2022Realistic One-shot Mesh-based Head Avatarscited by 119
- 2023CoDeF: Content Deformation Fields for Temporally Consistent Video Processingcited by 108
- 2024X-Portrait: Expressive Portrait Animation with Hierarchical Motion Attentioncited by 88
- 2025Multi-subject Open-set Personalization in Video Generationcited by 65
- 2023The Chosen One: Consistent Characters in Text-to-Image Diffusion Modelscited by 62
- 2024Customize-A-Video: One-Shot Motion Customization of Text-to-Video Diffusion Modelscited by 55
- 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Modelscited by 55
- 2023Face Animation with an Attribute-Guided Diffusion Modelcited by 48
- 2024LCM-Lookahead for Encoder-based Text-to-Image Personalizationcited by 48
- 2024Large-Scale Text-to-Image Model with Inpainting is a Zero-Shot Subject-Driven Image Generatorcited by 48
- 2024Diffusion Self-Distillation for Zero-Shot Customized Image Generationcited by 46
- 2022Implicit Warping for Animation with Image Setscited by 45
- 2024MegActor: Harness the Power of Raw Video for Vivid Portrait Animationcited by 27
- 2025Generating Multi-Image Synthetic Data for Text-to-Image Customizationcited by 25
- 2025Edit Transfer: Learning Image Editing via Vision In-Context Relationscited by 23
- 2023Context Diffusion: In-Context Aware Image Generationcited by 20
- 2025Dynamic Concepts Personalization from Single Videoscited by 20
- 2024Portrait Video Editing Empowered by Multimodal Generative Priorscited by 12
- 2024Video Diffusion Transformers are In-Context Learnerscited by 11
- 2024CustomTTT: Motion and Appearance Customized Video Generation via Test-Time Trainingcited by 9
- 2025DynVFX: Augmenting Real Videos with Dynamic Contentcited by 9
- 2025PoseGen: In-Context LoRA Finetuning for Pose-Controllable Long Human Video Generationcited by 8
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025LoRA-Edit: Controllable First-Frame-Guided Video Editing via Mask-Aware LoRA Fine-Tuning
- 2025Follow Your Motion: A Generic Temporal Consistency Portrait Editing Framework with Trajectory Guidance
- 2025FramePainter: Endowing Interactive Image Editing with Video Diffusion Priors
- 2026CollectionLoRA: Collecting 50 Effects in 1 LoRA via Multi-Teacher On-Policy Distillation
- 2025EchoShot: Multi-Shot Portrait Video Generation
- 2025LiON-LoRA: Rethinking LoRA Fusion to Unify Controllable Spatial and Temporal Generation for Video Diffusion
- 2024InVi: Object Insertion In Videos Using Off-the-Shelf Diffusion Models
- 2025Stable Video-Driven Portraits