VFXMaster: Unlocking Dynamic Visual Effect Generation via In-Context Learning
Not on the map. Why?
Abstract (arXiv)
Visual effects (VFX) are crucial to the expressive power of digital media, yet their creation remains a major challenge for generative AI. Prevailing methods often rely on the one-LoRA-per-effect paradigm, which is resource-intensive and fundamentally incapable of generalizing to unseen effects, thus limiting scalability and creation. To address this challenge, we introduce VFXMaster, the first unified, reference-based framework for VFX video generation. It recasts effect generation as an in-context learning task, enabling it to reproduce diverse dynamic effects from a reference video onto target content. In addition, it demonstrates remarkable generalization to unseen effect categories. Specifically, we design an in-context conditioning strategy that prompts the model with a reference example. An in-context attention mask is designed to precisely decouple and inject the essential effect attributes, allowing a single unified model to master the effect imitation without information leakage. In addition, we propose an efficient one-shot effect adaptation mechanism to boost generalization capability on tough unseen effects from a single user-provided video rapidly. Extensive experiments demonstrate that our method effectively imitates various categories of effect information and exhibits outstanding generalization to out-of-domain effects. To foster future research, we will release our code, models, and a comprehensive dataset to the community.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 36 of its 43 references that are in the map. First posted on arXiv 29 Oct 2025.
Builds on
36 of 43 references.
References · 36
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
24 more
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 185
- 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 178
- 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 168
- 2024ControlNeXt: Powerful and Efficient Control for Image and Video Generationcited by 159
- 2025Controllable Video Generation: A Surveycited by 98
- 2024SynCamMaster: Synchronizing Multi-Camera Video Generation from Diverse Viewpointscited by 93
- 2025CineMaster: A 3D-Aware and Controllable Framework for Cinematic Text-to-Video Generationcited by 74
- 2021DiffPD: Differentiable Projective Dynamicscited by 62
- 2025VLIPP: Towards Physically Plausible Video Generation with Vision and Language Informed Physical Priorcited by 52
- 2025MotionCanvas: Cinematic Shot Design with Controllable Image-to-Video Generationcited by 50
- 2024StyleMaster: Stylize Your Video with Artistic Generation and Translationcited by 47
- 2024Track4Gen: Teaching Video Diffusion Models to Track Points Improves Video Generationcited by 44
- 2024StableIdentity: Inserting Anybody into Anywhere at First Sightcited by 35
- 2025Omni-Effects: Unified and Spatially-Controllable Visual Effects Generationcited by 27
- 2025FlexiAct: Towards Flexible Action Control in Heterogeneous Scenarioscited by 25
- 2025VFX Creator: Animated Visual Effect Generation with Controllable Diffusion Transformercited by 16
- 2025LayerAnimate: Layer-level Control for Animationcited by 12
Built on by
Citing papers per year: 2025: 3; 2026: 9.
12 papers.
- 2025MultiShotMaster: A Controllable Multi-Shot Video Generation Frameworkcited by 36
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmapcited by 15
- 2026StreamingEffect: Real-Time Human-Centric Video Effect Generationcited by 8
- 2026MoCha:End-to-End Video Character Replacement without Structural Guidancecited by 6
- 2025Over++: Generative Video Compositing for Layer Interaction Effectscited by 3
- 2026Let Your Image Move with Your Motion! -- Implicit Multi-Object Multi-Motion Transfercited by 3
- 2026EffectMaker: Unifying Reasoning and Generation for Customized Visual Effect Creationcited by 2
- 2026EasyVFX: Frequency-Driven Decoupling for Resource-Efficient VFX Generationcited by 2
- 2026Video2LoRA: Unified Semantic-Controlled Video Generation via Per-Reference-Video LoRAcited by 0
- 2026Vera: A Layered Diffusion Model for Content-Preserving Video Editingcited by 0
- 2026Disco-LoRA: Disentangled Composition of Content, Style, and Motion for Multi-concept Video Customizationcited by 0
- 2026Controlling Motion Transfer in Diffusion Transformers via Attention Headscited by 0
- 2026Controlling Motion Transfer in Diffusion Transformers via Attention Heads13 Jul 2026
- 2026Disco-LoRA: Disentangled Composition of Content, Style, and Motion for Multi-concept Video Customization25 Jun 2026
- 2026Vera: A Layered Diffusion Model for Content-Preserving Video Editing22 Jun 2026
- 2026EasyVFX: Frequency-Driven Decoupling for Resource-Efficient VFX Generation21 May 2026
- 2026StreamingEffect: Real-Time Human-Centric Video Effect Generation16 May 2026
- 2026Video2LoRA: Unified Semantic-Controlled Video Generation via Per-Reference-Video LoRA9 Mar 2026
- 2026EffectMaker: Unifying Reasoning and Generation for Customized Visual Effect Creation6 Mar 2026
- 2026Let Your Image Move with Your Motion! -- Implicit Multi-Object Multi-Motion Transfer1 Mar 2026
- 2026MoCha:End-to-End Video Character Replacement without Structural Guidance13 Jan 2026
- 2025Over++: Generative Video Compositing for Layer Interaction Effects22 Dec 2025
- 2025MultiShotMaster: A Controllable Multi-Shot Video Generation Framework2 Dec 2025
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmap11 Nov 2025