mlsanityData to 14 Oct 2026

VFXMaster: Unlocking Dynamic Visual Effect Generation via In-Context Learning

arXiv 2510.25772 ↗First posted 29 Oct 2025cs.CVcited by 12

Not on the map. Why?

Abstract (arXiv)

Visual effects (VFX) are crucial to the expressive power of digital media, yet their creation remains a major challenge for generative AI. Prevailing methods often rely on the one-LoRA-per-effect paradigm, which is resource-intensive and fundamentally incapable of generalizing to unseen effects, thus limiting scalability and creation. To address this challenge, we introduce VFXMaster, the first unified, reference-based framework for VFX video generation. It recasts effect generation as an in-context learning task, enabling it to reproduce diverse dynamic effects from a reference video onto target content. In addition, it demonstrates remarkable generalization to unseen effect categories. Specifically, we design an in-context conditioning strategy that prompts the model with a reference example. An in-context attention mask is designed to precisely decouple and inject the essential effect attributes, allowing a single unified model to master the effect imitation without information leakage. In addition, we propose an efficient one-shot effect adaptation mechanism to boost generalization capability on tough unseen effects from a single user-provided video rapidly. Extensive experiments demonstrate that our method effectively imitates various categories of effect information and exhibits outstanding generalization to out-of-domain effects. To foster future research, we will release our code, models, and a comprehensive dataset to the community.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 36 of its 43 references that are in the map. First posted on arXiv 29 Oct 2025.

Builds on

36 of 43 references.

References · 36

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  6. 2022Scalable Diffusion Models with Transformerscited by 6,054
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  8. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  9. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  10. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  11. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  12. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
24 more
  1. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  2. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  3. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  4. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  5. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  6. 2025VACE: All-in-One Video Creation and Editingcited by 479
  7. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
  8. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 185
  9. 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 178
  10. 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 168
  11. 2024ControlNeXt: Powerful and Efficient Control for Image and Video Generationcited by 159
  12. 2025Controllable Video Generation: A Surveycited by 98
  13. 2024SynCamMaster: Synchronizing Multi-Camera Video Generation from Diverse Viewpointscited by 93
  14. 2025CineMaster: A 3D-Aware and Controllable Framework for Cinematic Text-to-Video Generationcited by 74
  15. 2021DiffPD: Differentiable Projective Dynamicscited by 62
  16. 2025VLIPP: Towards Physically Plausible Video Generation with Vision and Language Informed Physical Priorcited by 52
  17. 2025MotionCanvas: Cinematic Shot Design with Controllable Image-to-Video Generationcited by 50
  18. 2024StyleMaster: Stylize Your Video with Artistic Generation and Translationcited by 47
  19. 2024Track4Gen: Teaching Video Diffusion Models to Track Points Improves Video Generationcited by 44
  20. 2024StableIdentity: Inserting Anybody into Anywhere at First Sightcited by 35
  21. 2025Omni-Effects: Unified and Spatially-Controllable Visual Effects Generationcited by 27
  22. 2025FlexiAct: Towards Flexible Action Control in Heterogeneous Scenarioscited by 25
  23. 2025VFX Creator: Animated Visual Effect Generation with Controllable Diffusion Transformercited by 16
  24. 2025LayerAnimate: Layer-level Control for Animationcited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 9.

12 papers.