GeoDiffMM: Geometry-Guided Conditional Diffusion for Motion Magnification
Not on the map. Why?
Abstract (arXiv)
Video Motion Magnification (VMM) amplifies subtle macroscopic motions to a perceptible level. Recently, existing mainstream Eulerian approaches address amplification-induced noise via decoupling representation learning such as texture, shape and frequency schemes, but they still struggle to mitigate the interference of photon noise on true micro-motion when motion displacements are very small. We propose GeoDiffMM, a novel diffusion-based Lagrangian VMM framework conditioned on optical flow as a geometric cue, enabling structurally consistent motion magnification. Specifically, we design a Noise-Free Optical Flow Augmentation strategy that synthesizes diverse nonrigid motion fields without photon noise as supervision, helping the model learn more accurate geometry-aware optical flow and generalize better. Next, we develop a Diffusion Motion Magnifier that conditions the denoising process on (i) optical flow as a geometry prior and (ii) a learnable magnification factor controlling magnitude, thereby selectively amplifying motion components consistent with scene semantics and structure. Finally, we perform Flow-based Video Synthesis to map the amplified motion back to the image domain with high fidelity. Extensive experiments on real and synthetic datasets show that GeoDiffMM outperforms state-of-the-art methods and significantly improves motion magnification.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 39 of its 65 references that are in the map. First posted on arXiv 9 Dec 2025.
Builds on
39 of 65 references.
References · 39
- 2017Attention Is All You Needcited by 59,932
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2022Video Diffusion Modelscited by 2,280
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 568
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 450
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
- 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
27 more
- 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 321
- 2017Video Frame Synthesis using Deep Voxel Flowcited by 209
- 2023Conditional Image-to-Video Generation with Latent Flow Diffusion Modelscited by 180
- 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 176
- 2016View Synthesis by Appearance Flowcited by 172
- 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 169
- 2022FILM: Frame Interpolation for Large Motioncited by 149
- 2020Learning by Analogy: Reliable Supervision from Transformations for Unsupervised Optical Flow Estimationcited by 120
- 2023The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimationcited by 116
- 2022Highly Accurate Dichotomous Image Segmentationcited by 110
- 2023MotionEditor: Editing Video Motion via Content-Aware Diffusioncited by 56
- 2018Learning-based Video Motion Magnificationcited by 43
- 2024CleanDIFT: Diffusion Features without Noisecited by 42
- 2022A Unified Pyramid Recurrent Network for Video Frame Interpolationcited by 39
- 2025FloVD: Optical Flow Meets Video Diffusion Model for Enhanced Camera-Controlled Video Synthesiscited by 37
- 2020Revealing the Invisible with Model and Data Shrinking for Composite-database Micro-expression Recognitioncited by 31
- 2025DPFlow: Adaptive Optical Flow Estimation with a Dual-Pyramid Frameworkcited by 30
- 2024Frequency Decoupling for Motion Magnification via Multi-Level Isomorphic Architecturecited by 28
- 2023EulerMormer: Robust Eulerian Motion Magnification via Dynamic Filtering within Transformercited by 27
- 2017Video Acceleration Magnificationcited by 16
- 2024OnlyFlow: Optical Flow based Motion Conditioning for Video Diffusion Modelscited by 15
- 2023StreamFlow: Streamlined Multi-Frame Optical Flow Estimation for Video Sequencescited by 12
- 2024Disentangled Motion Modeling for Video Frame Interpolationcited by 11
- 2023Self-Supervised Motion Magnification by Backpropagating Through Optical Flowcited by 10
- 2022Lagrangian Motion Magnification with Double Sparse Optical Flow Decompositioncited by 7
- 2023Learning-based Axial Video Motion Magnificationcited by 4
- 2025AMMSM: Adaptive Motion Magnification and Sparse Mamba for Micro-Expression Recognitioncited by 1
Built on by
Not cited yet.