mlsanityData to 14 Oct 2026

Following Motion for Sequential Modeling in Video Frame Interpolation

arXiv 2608.22861 ↗First posted 24 Aug 2026cs.CVcited by 0

On the map: State-space sequence models (S4, Mamba) → Video, motion and generative Mamba models

Abstract (arXiv)

State Space Models (SSMs) have surfaced as a promising architecture in Video Frame Interpolation (VFI), as they can capture long-range dependencies with linear computational complexity. However, their predefined scanning order limits their effectiveness in modeling the dynamic motion trajectories inherent in VFI problems. To tackle this challenge, we propose Motion-Guided Mamba for Video Frame Interpolation (MGMVFI), an adaptation of the selective state space model tailored explicitly for VFI. MGMVFI introduces Motion-Guided Serialization (MGS), which leverages optical flow to define a motion-adaptive 1D input order for the SSM. This aligns the causal state updates with semantically related tokens, enabling motion-consistent feature propagation, particularly for large and dynamic motions. Additionally, to mitigate the unreliable feature representations caused by inaccurate optical flow estimates, we introduce contextual synthesis that utilizes the surrounding spatial context for robust inter-frame feature synthesis. These components are seamlessly integrated within our tailored Mamba architecture, which also employs a lightweight refinement block to enhance local detail reconstruction at a reduced computational cost. Extensive experiments on standard VFI benchmarks demonstrate that MGMVFI achievesstate-of-the-artperformance,particularly on complex and dynamic motions, thereby establishing a new direction for sequence modeling in video interpolation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video, motion and generative Mamba models, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 44 of its 51 references that are in the map. First posted on arXiv 24 Aug 2026.

Builds on

44 of 51 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Motion Mamba: Efficient and Long Sequence Motion Generation12 Mar
  2. 2024VideoMamba: State Space Model for Efficient Video Understanding11 Mar

Other references · 42

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  3. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  4. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  5. 2024VMamba: Visual State Space Modelcited by 969
  6. 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 968
  7. 2017Video Enhancement with Task-Oriented Flowcited by 619
  8. 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 608
  9. 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 352
  10. 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 326
  11. 2020Softmax Splatting for Video Frame Interpolationcited by 279
  12. 2019Depth-Aware Video Frame Interpolationcited by 234
30 more
  1. 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 225
  2. 2017Video Frame Interpolation via Adaptive Separable Convolutioncited by 213
  3. 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 213
  4. 2017Video Frame Synthesis using Deep Voxel Flowcited by 209
  5. 2015DeepStereo: Learning to Predict New Views from the World's Imagerycited by 185
  6. 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
  7. 2016View Synthesis by Appearance Flowcited by 172
  8. 2018Context-aware Synthesis for Video Frame Interpolationcited by 153
  9. 2016Learning-Based View Synthesis for Light Field Camerascited by 145
  10. 2019AdaCoF: Adaptive Collaboration of Flows for Video Frame Interpolationcited by 134
  11. 2021XVFI: eXtreme Video Frame Interpolationcited by 126
  12. 2021Video Frame Interpolation Transformercited by 123
  13. 2020BMBC:Bilateral Motion Estimation with Bilateral Cost Volume for Video Interpolationcited by 118
  14. 2022IFRNet: Intermediate Feature Refine Network for Efficient Frame Interpolationcited by 109
  15. 2021Asymmetric Bilateral Motion Estimation for Video Frame Interpolationcited by 101
  16. 2023Extracting Motion and Appearance via Inter-Frame Attention for Efficient Video Frame Interpolationcited by 98
  17. 2024MambaIRv2: Attentive State Space Restorationcited by 94
  18. 2023LDMVFI: Video Frame Interpolation with Latent Diffusion Modelscited by 89
  19. 2024Video Interpolation with Diffusion Modelscited by 68
  20. 2020Multiple Video Frame Interpolation via Enhanced Deformable Separable Convolutioncited by 63
  21. 2022Many-to-many Splatting for Efficient Video Frame Interpolationcited by 42
  22. 2016Learning Image Matching by Simply Watching Videocited by 41
  23. 2024Efficient Visual State Space Model for Image Deblurringcited by 29
  24. 2024Sparse Global Matching for Video Frame Interpolation with Large Motioncited by 28
  25. 2024VFIMamba: Video Frame Interpolation with State Space Modelscited by 22
  26. 2024Frame Interpolation with Consecutive Brownian Bridge Diffusioncited by 19
  27. 2025EDEN: Enhanced Diffusion for High-quality Large-motion Video Frame Interpolationcited by 19
  28. 2024TinyViM: Frequency Decoupling for Tiny Hybrid Vision Mambacited by 15
  29. 2025A Survey on Mamba Architecture for Vision Applicationscited by 8
  30. 2025TLB-VFI: Temporal-Aware Latent Brownian Bridge Diffusion for Video Frame Interpolationcited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026MASS: Motion-Aligned Selective Scan for Refinement in Flow-Based Video Frame Interpolation
  2. 2026SNM-VFI: Symmetric Nonlinear Motion-Guided Generative Video Frame Interpolation
  3. 2026FC-VFI: Faithful and Consistent Video Frame Interpolation for High-FPS Slow Motion Video Generation
  4. 2024Disentangled Motion Modeling for Video Frame Interpolation
  5. 2026SPEED: One-Step Pixel Diffusion for High-quality Video Frame Interpolation
  6. 2024Motion-aware Latent Diffusion Models for Video Frame Interpolation
  7. 2025MambaVSR: Content-Aware Scanning State Space Model for Video Super-Resolution
  8. 2025Gather-Scatter Mamba: Accelerating Propagation with Efficient State Space Model