MASS: Motion-Aligned Selective Scan for Refinement in Flow-Based Video Frame Interpolation
Not on the map. Why?
Abstract (arXiv)
Video frame interpolation (VFI) remains a challenging task, particularly when dealing with large, non-linear motions and complex occlusions. While flow-based methods are prevalent, they often struggle with ambiguous correspondences. Recent VFI methods based on selective State Space Models (SSMs) are still limited by static grid-based scanning that misaligns with physical motion. In this paper, we propose Motion-Aligned Selective Scan (MASS), a novel framework that reformulates feature scanning from static spatial grids to dynamic motion trajectories. MASS builds a feature sequence along each pixel's flow-guided trajectory and aggregates it with an SSM. Specifically, we introduce a learnable non-linear path integration to approximate complex curved trajectories via residual velocity updates, and a velocity-aware SSM that dynamically adjusts the sampling budget and step size based on motion magnitude. This adaptive strategy allocates denser sampling to fast-motion regions while keeping static regions efficient. Furthermore, the aggregated states guide a refinement module to rectify intermediate flows and masks in an end-to-end manner. Extensive experiments indicate that MASS achieves highly competitive overall performance on standard benchmarks, establishing state-of-the-art results particularly in challenging scenarios with large displacements and complex dynamics.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 44 references that are in the map. First posted on arXiv 26 Jun 2026.
Builds on
35 of 44 references.
References · 35
- 2017Attention Is All You Needcited by 60,361
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
- 2024VMamba: Visual State Space Modelcited by 969
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 968
- 2017Video Enhancement with Task-Oriented Flowcited by 619
- 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 326
- 2020Softmax Splatting for Video Frame Interpolationcited by 279
- 2019Depth-Aware Video Frame Interpolationcited by 234
- 2024MambaVision: A Hybrid Mamba-Transformer Vision Backbonecited by 224
23 more
- 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 213
- 2015DeepStereo: Learning to Predict New Views from the World's Imagerycited by 185
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
- 2022FILM: Frame Interpolation for Large Motioncited by 153
- 2016Learning-Based View Synthesis for Light Field Camerascited by 145
- 2018Video Compression through Image Interpolationcited by 143
- 2019AdaCoF: Adaptive Collaboration of Flows for Video Frame Interpolationcited by 134
- 2021XVFI: eXtreme Video Frame Interpolationcited by 126
- 2021Video Frame Interpolation Transformercited by 123
- 2022IFRNet: Intermediate Feature Refine Network for Efficient Frame Interpolationcited by 109
- 2021Asymmetric Bilateral Motion Estimation for Video Frame Interpolationcited by 101
- 2023Extracting Motion and Appearance via Inter-Frame Attention for Efficient Video Frame Interpolationcited by 98
- 2020Zooming Slow-Mo: Fast and Accurate One-Stage Space-Time Video Super-Resolutioncited by 91
- 2023LDMVFI: Video Frame Interpolation with Latent Diffusion Modelscited by 89
- 2020Enhanced Quadratic Video Interpolationcited by 48
- 2022Many-to-many Splatting for Efficient Video Frame Interpolationcited by 42
- 2022A Unified Pyramid Recurrent Network for Video Frame Interpolationcited by 39
- 2024Sparse Global Matching for Video Frame Interpolation with Large Motioncited by 28
- 2023BiFormer: Learning Bilateral Motion Estimation via Bilateral Transformer for 4K Video Frame Interpolationcited by 23
- 2024VFIMamba: Video Frame Interpolation with State Space Modelscited by 22
- 2025EDEN: Enhanced Diffusion for High-quality Large-motion Video Frame Interpolationcited by 19
- 2022TTVFI: Learning Trajectory-Aware Transformer for Video Frame Interpolationcited by 14
- 2025VCMamba: Bridging Convolutions with Multi-Directional Mamba for Efficient Visual Representationcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Following Motion for Sequential Modeling in Video Frame Interpolation
- 2026SPEED: One-Step Pixel Diffusion for High-quality Video Frame Interpolation
- 2024Motion-aware Latent Diffusion Models for Video Frame Interpolation
- 2026FC-VFI: Faithful and Consistent Video Frame Interpolation for High-FPS Slow Motion Video Generation
- 2026SNM-VFI: Symmetric Nonlinear Motion-Guided Generative Video Frame Interpolation
- 2024Disentangled Motion Modeling for Video Frame Interpolation
- 2024BiM-VFI: Bidirectional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motions
- 2026Stable Velocity: A Variance Perspective on Flow Matching