mlsanityData to 7 Oct 2026

In-Context Sync-LoRA for Portrait Video Editing

arXiv 2512.03013 ↗First posted 2 Dec 2025cs.CV cs.AI cs.GRcited by 3

Not on the map. Why?

Abstract (arXiv)

Editing portrait videos is a challenging task that requires flexible yet precise control over a wide range of modifications, such as appearance changes, expression edits, or the addition of objects. The key difficulty lies in preserving the subject's original temporal behavior, demanding that every edited frame remains precisely synchronized with the corresponding source frame. We present Sync-LoRA, a method for editing portrait videos that achieves high-quality visual modifications while maintaining frame-accurate synchronization and identity consistency. Our approach uses an image-to-video diffusion model, where the edit is defined by modifying the first frame and then propagated to the entire sequence. To enable accurate synchronization, we train an in-context LoRA using paired videos that depict identical motion trajectories but differ in appearance. These pairs are automatically generated and curated through a synchronization-based filtering process that selects only the most temporally aligned examples for training. This training setup teaches the model to combine motion cues from the source video with the visual changes introduced in the edited first frame. Trained on a compact, highly curated set of synchronized human portraits, Sync-LoRA generalizes to unseen identities and diverse edits (e.g., modifying appearance, adding objects, or changing backgrounds), robustly handling variations in pose and expression. Our results demonstrate high visual fidelity and strong temporal coherence, achieving a robust balance between edit fidelity and precise motion preservation.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 49 of its 61 references that are in the map. First posted on arXiv 2 Dec 2025.

Builds on

49 of 61 references.

References · 49

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  4. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  6. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  7. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  8. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
  9. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
  10. 2020First Order Motion Model for Image Animationcited by 698
  11. 2023Zero-shot Image-to-Image Translationcited by 503
  12. 2025VACE: All-in-One Video Creation and Editingcited by 467
37 more
  1. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
  2. 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 438
  3. 2023Pix2Video: Video Editing using Image Diffusioncited by 318
  4. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
  5. 2020StyleRig: Rigging StyleGAN for 3D Control over Portrait Imagescited by 267
  6. 2023Style Aligned Image Generation via Shared Attentioncited by 214
  7. 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 214
  8. 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 202
  9. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
  10. 2024AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animationcited by 191
  11. 2023Dreamix: Video Diffusion Models are General Video Editorscited by 189
  12. 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 172
  13. 2024In-Context LoRA for Diffusion Transformerscited by 155
  14. 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 151
  15. 2024ReNoise: Real Image Inversion Through Iterative Noisingcited by 127
  16. 2022Realistic One-shot Mesh-based Head Avatarscited by 119
  17. 2023CoDeF: Content Deformation Fields for Temporally Consistent Video Processingcited by 108
  18. 2024X-Portrait: Expressive Portrait Animation with Hierarchical Motion Attentioncited by 88
  19. 2025Multi-subject Open-set Personalization in Video Generationcited by 65
  20. 2023The Chosen One: Consistent Characters in Text-to-Image Diffusion Modelscited by 62
  21. 2024Customize-A-Video: One-Shot Motion Customization of Text-to-Video Diffusion Modelscited by 55
  22. 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Modelscited by 55
  23. 2023Face Animation with an Attribute-Guided Diffusion Modelcited by 48
  24. 2024LCM-Lookahead for Encoder-based Text-to-Image Personalizationcited by 48
  25. 2024Large-Scale Text-to-Image Model with Inpainting is a Zero-Shot Subject-Driven Image Generatorcited by 48
  26. 2024Diffusion Self-Distillation for Zero-Shot Customized Image Generationcited by 46
  27. 2022Implicit Warping for Animation with Image Setscited by 45
  28. 2024MegActor: Harness the Power of Raw Video for Vivid Portrait Animationcited by 27
  29. 2025Generating Multi-Image Synthetic Data for Text-to-Image Customizationcited by 25
  30. 2025Edit Transfer: Learning Image Editing via Vision In-Context Relationscited by 23
  31. 2023Context Diffusion: In-Context Aware Image Generationcited by 20
  32. 2025Dynamic Concepts Personalization from Single Videoscited by 20
  33. 2024Portrait Video Editing Empowered by Multimodal Generative Priorscited by 12
  34. 2024Video Diffusion Transformers are In-Context Learnerscited by 11
  35. 2024CustomTTT: Motion and Appearance Customized Video Generation via Test-Time Trainingcited by 9
  36. 2025DynVFX: Augmenting Real Videos with Dynamic Contentcited by 9
  37. 2025PoseGen: In-Context LoRA Finetuning for Pose-Controllable Long Human Video Generationcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025LoRA-Edit: Controllable First-Frame-Guided Video Editing via Mask-Aware LoRA Fine-Tuning
  2. 2025Follow Your Motion: A Generic Temporal Consistency Portrait Editing Framework with Trajectory Guidance
  3. 2025FramePainter: Endowing Interactive Image Editing with Video Diffusion Priors
  4. 2026CollectionLoRA: Collecting 50 Effects in 1 LoRA via Multi-Teacher On-Policy Distillation
  5. 2025EchoShot: Multi-Shot Portrait Video Generation
  6. 2025LiON-LoRA: Rethinking LoRA Fusion to Unify Controllable Spatial and Temporal Generation for Video Diffusion
  7. 2024InVi: Object Insertion In Videos Using Off-the-Shelf Diffusion Models
  8. 2025Stable Video-Driven Portraits