mlsanityData to 7 Oct 2026

GeoDiffMM: Geometry-Guided Conditional Diffusion for Motion Magnification

arXiv 2512.08325 ↗First posted 9 Dec 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Video Motion Magnification (VMM) amplifies subtle macroscopic motions to a perceptible level. Recently, existing mainstream Eulerian approaches address amplification-induced noise via decoupling representation learning such as texture, shape and frequency schemes, but they still struggle to mitigate the interference of photon noise on true micro-motion when motion displacements are very small. We propose GeoDiffMM, a novel diffusion-based Lagrangian VMM framework conditioned on optical flow as a geometric cue, enabling structurally consistent motion magnification. Specifically, we design a Noise-Free Optical Flow Augmentation strategy that synthesizes diverse nonrigid motion fields without photon noise as supervision, helping the model learn more accurate geometry-aware optical flow and generalize better. Next, we develop a Diffusion Motion Magnifier that conditions the denoising process on (i) optical flow as a geometry prior and (ii) a learnable magnification factor controlling magnitude, thereby selectively amplifying motion components consistent with scene semantics and structure. Finally, we perform Flow-based Video Synthesis to map the amplified motion back to the image domain with high fidelity. Extensive experiments on real and synthetic datasets show that GeoDiffMM outperforms state-of-the-art methods and significantly improves motion magnification.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 39 of its 65 references that are in the map. First posted on arXiv 9 Dec 2025.

Builds on

39 of 65 references.

References · 39

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  7. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  8. 2022Video Diffusion Modelscited by 2,280
  9. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 568
  10. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 450
  11. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
  12. 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
27 more
  1. 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 321
  2. 2017Video Frame Synthesis using Deep Voxel Flowcited by 209
  3. 2023Conditional Image-to-Video Generation with Latent Flow Diffusion Modelscited by 180
  4. 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 176
  5. 2016View Synthesis by Appearance Flowcited by 172
  6. 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 169
  7. 2022FILM: Frame Interpolation for Large Motioncited by 149
  8. 2020Learning by Analogy: Reliable Supervision from Transformations for Unsupervised Optical Flow Estimationcited by 120
  9. 2023The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimationcited by 116
  10. 2022Highly Accurate Dichotomous Image Segmentationcited by 110
  11. 2023MotionEditor: Editing Video Motion via Content-Aware Diffusioncited by 56
  12. 2018Learning-based Video Motion Magnificationcited by 43
  13. 2024CleanDIFT: Diffusion Features without Noisecited by 42
  14. 2022A Unified Pyramid Recurrent Network for Video Frame Interpolationcited by 39
  15. 2025FloVD: Optical Flow Meets Video Diffusion Model for Enhanced Camera-Controlled Video Synthesiscited by 37
  16. 2020Revealing the Invisible with Model and Data Shrinking for Composite-database Micro-expression Recognitioncited by 31
  17. 2025DPFlow: Adaptive Optical Flow Estimation with a Dual-Pyramid Frameworkcited by 30
  18. 2024Frequency Decoupling for Motion Magnification via Multi-Level Isomorphic Architecturecited by 28
  19. 2023EulerMormer: Robust Eulerian Motion Magnification via Dynamic Filtering within Transformercited by 27
  20. 2017Video Acceleration Magnificationcited by 16
  21. 2024OnlyFlow: Optical Flow based Motion Conditioning for Video Diffusion Modelscited by 15
  22. 2023StreamFlow: Streamlined Multi-Frame Optical Flow Estimation for Video Sequencescited by 12
  23. 2024Disentangled Motion Modeling for Video Frame Interpolationcited by 11
  24. 2023Self-Supervised Motion Magnification by Backpropagating Through Optical Flowcited by 10
  25. 2022Lagrangian Motion Magnification with Double Sparse Optical Flow Decompositioncited by 7
  26. 2023Learning-based Axial Video Motion Magnificationcited by 4
  27. 2025AMMSM: Adaptive Motion Magnification and Sparse Mamba for Micro-Expression Recognitioncited by 1

Built on by

Not cited yet.