mlsanityData to 13 Oct 2026

Over++: Generative Video Compositing for Layer Interaction Effects

arXiv 2512.19661 ↗First posted 22 Dec 2025cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

In professional video compositing workflows, artists must manually create environmental interactions-such as shadows, reflections, dust, and splashes-between foreground subjects and background layers. Existing video generative models struggle to preserve the input video while adding such effects, and current video inpainting methods either require costly per-frame masks or yield implausible results. We introduce augmented compositing, a new task that synthesizes realistic, semi-transparent environmental effects conditioned on text prompts and input video layers, while preserving the original scene. To address this task, we present Over++, a video effect generation framework that makes no assumptions about camera pose, scene stationarity, or depth supervision. We construct a paired effect dataset tailored for this task and introduce an unpaired augmentation strategy that preserves text-driven editability. Our method also supports optional mask control and keyframe guidance without requiring dense annotations. Despite training on limited data, Over++ produces diverse and realistic environmental effects and outperforms existing baselines in both effect generation and scene preservation.

Key facts. Cited by 3 papers in the map (data through 13 Oct 2026). Builds on 61 of its 77 references that are in the map. First posted on arXiv 22 Dec 2025.

Builds on

61 of 77 references.

References · 61

  1. 2017Attention Is All You Needcited by 60,106
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,952
  3. 2024The Llama 3 Herd of Modelscited by 14,486
  4. 2020Denoising Diffusion Implicit Modelscited by 9,718
  5. 2022Classifier-Free Diffusion Guidancecited by 5,785
  6. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,299
  7. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,294
  8. 2024SAM 2: Segment Anything in Images and Videoscited by 2,820
  9. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,610
  10. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,407
  11. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,240
  12. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,775
38 more
  1. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,732
  2. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,070
  3. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 949
  4. 2024LTX-Video: Realtime Video Latent Diffusioncited by 560
  5. 2025VACE: All-in-One Video Creation and Editingcited by 473
  6. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 451
  7. 2022Kubric: A scalable dataset generatorcited by 375
  8. 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 277
  9. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 185
  10. 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Modelscited by 172
  11. 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 170
  12. 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 152
  13. 2024ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generationcited by 132
  14. 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 128
  15. 2024Eliminating Oversaturation and Artifacts of High Guidance Scales in Diffusion Modelscited by 111
  16. 2025Seaweed-7B: Cost-Effective Training of Video Generation Foundation Modelcited by 82
  17. 2023AVID: Any-Length Video Inpainting with Diffusion Modelcited by 81
  18. 2025DiffuEraser: A Diffusion Model for Video Inpaintingcited by 69
  19. 2025ConceptMaster: Multi-Concept Video Customization on Diffusion Transformer Models Without Test-Time Tuningcited by 68
  20. 2025PhysGen3D: Crafting a Miniature Interactive World from a Single Imagecited by 65
  21. 2022Harmonizer: Learning to Perform White-Box Image and Video Harmonizationcited by 61
  22. 2020Countering Language Drift with Seeded Iterated Learningcited by 57
  23. 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Modelscited by 55
  24. 2025UNIC: Unified In-Context Video Editingcited by 55
  25. 2025Force Prompting: Video Generation Models Can Learn and Generalize Physics-based Control Signalscited by 51
  26. 2021Omnimatte: Associating Objects and Their Effects in Videocited by 50
  27. 2025PISA Experiments: Exploring Physics Post-Training for Video Diffusion Models by Watching Stuff Dropcited by 50
  28. 2024PhysMotion: Physics-Grounded Dynamics From a Single Imagecited by 45
  29. 2025HuMo: Human-Centric Video Generation via Collaborative Multi-Modal Conditioningcited by 45
  30. 2024Magic Fixup: Streamlining Photo Editing by Watching Dynamic Videoscited by 38
  31. 2024Generative Omnimatte: Learning to Decompose Video into Layerscited by 38
  32. 2025ROSE: Remove Objects with Side Effects in Videoscited by 34
  33. 2024Generative Image Layer Decomposition with Visual Effectscited by 33
  34. 2025LoRA-Edit: Controllable First-Frame-Guided Video Editing via Mask-Aware LoRA Fine-Tuningcited by 27
  35. 2025Omni-Effects: Unified and Spatially-Controllable Visual Effects Generationcited by 27
  36. 2025ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichmentcited by 27
  37. 2025RORem: Training a Robust Object Remover with Human-in-the-Loopcited by 23
  38. 2025DreamActor-H1: High-Fidelity Human-Product Demonstration Video Generation via Motion-designed Diffusion Transformerscited by 21

50 most cited of 61 All 61 (JSON)

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 3.

3 papers.