IC-Effect: Precise and Efficient Video Effects Editing via In-Context Learning
Not on the map. Why?
Abstract (arXiv)
We propose IC-Effect, an instruction-guided, DiT-based framework for few-shot video VFX editing that synthesizes complex effects (eg flames, particles and cartoon characters) while strictly preserving spatial and temporal consistency. Video VFX editing is highly challenging because injected effects must blend seamlessly with the background, the background must remain entirely unchanged, and effect patterns must be learned efficiently from limited paired data. However, existing video editing models fail to satisfy these requirements. IC-Effect leverages the source video as clean contextual conditions, exploiting the contextual learning capability of DiT models to achieve precise background preservation and natural effect injection. A two-stage training strategy, consisting of general editing adaptation followed by effect-specific learning via Effect-LoRA, ensures strong instruction following and robust effect modeling. To further improve efficiency, we introduce spatiotemporal sparse tokenization, enabling high fidelity with substantially reduced computation. We also release a paired VFX editing dataset spanning 15 high-quality visual styles. Extensive experiments show that IC-Effect delivers high-quality, controllable, and temporally consistent VFX editing, opening new possibilities for video creation.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 52 of its 60 references that are in the map. First posted on arXiv 17 Dec 2025.
Builds on
52 of 60 references.
References · 52
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
38 more
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
- 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 207
- 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 174
- 2024In-Context LoRA for Diffusion Transformerscited by 158
- 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
- 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 143
- 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 119
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
- 2023VideoControlNet: A Motion-Guided Video-to-Video Translation Framework by Using Diffusion Model with ControlNetcited by 83
- 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 81
- 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
- 2025DiffuEraser: A Diffusion Model for Video Inpaintingcited by 72
- 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondencecited by 69
- 2025InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Constructioncited by 62
- 2025OminiControl2: Efficient Conditioning for Diffusion Transformerscited by 57
- 2025UNIC: Unified In-Context Video Editingcited by 55
- 2024Stable-Makeup: When Real-World Makeup Transfer Meets Diffusion Modelcited by 45
- 2025MakeAnything: Harnessing Diffusion Transformers for Multi-Domain Procedural Sequence Generationcited by 45
- 2025LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformercited by 43
- 2024ProcessPainter: Learn Painting Process from Sequence Datacited by 38
- 2024Stable-Hair: Real-World Hair Transfer via Diffusion Modelcited by 35
- 2025LoRA-Edit: Controllable First-Frame-Guided Video Editing via Mask-Aware LoRA Fine-Tuningcited by 28
- 2025Omni-Effects: Unified and Spatially-Controllable Visual Effects Generationcited by 27
- 2025PhotoDoodle: Learning Artistic Image Editing from Few-Shot Pairwise Datacited by 24
- 2025Edit Transfer: Learning Image Editing via Vision In-Context Relationscited by 23
- 2023MAG-Edit: Localized Image Editing in Complex Scenarios via Mask-Based Attention-Adjusted Guidancecited by 21
- 2025VFX Creator: Animated Visual Effect Generation with Controllable Diffusion Transformercited by 16
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026StreamingEffect: Real-Time Human-Centric Video Effect Generationcited by 8
- 2026Soap2Soap: Long Cinematic Video Remaking via Multi-Agent Collaborationcited by 5
- 2026OmniHumanoid: Streaming Cross-Embodiment Video Generation with Paired-Free Adaptationcited by 4
- 2026SIGMA: Selective-Interleaved Generation with Multi-Attribute Tokenscited by 2
- 2026Soap2Soap: Long Cinematic Video Remaking via Multi-Agent Collaboration17 May 2026
- 2026StreamingEffect: Real-Time Human-Centric Video Effect Generation16 May 2026
- 2026OmniHumanoid: Streaming Cross-Embodiment Video Generation with Paired-Free Adaptation12 May 2026
- 2026SIGMA: Selective-Interleaved Generation with Multi-Attribute Tokens7 Feb 2026