mlsanityData to 7 Oct 2026

MiVID: Multi-Strategic Self-Supervision for Video Frame Interpolation using Diffusion Model

arXiv 2511.06019 ↗First posted 8 Nov 2025cs.CV cs.AIcited by 0

On the map: Diffusion models → Video generation

Abstract (arXiv)

Video Frame Interpolation (VFI) remains a cornerstone in video enhancement, enabling temporal upscaling for tasks like slow-motion rendering, frame rate conversion, and video restoration. While classical methods rely on optical flow and learning-based models assume access to dense ground-truth, both struggle with occlusions, domain shifts, and ambiguous motion. This article introduces MiVID, a lightweight, self-supervised, diffusion-based framework for video interpolation. Our model eliminates the need for explicit motion estimation by combining a 3D U-Net backbone with transformer-style temporal attention, trained under a hybrid masking regime that simulates occlusions and motion uncertainty. The use of cosine-based progressive masking and adaptive loss scheduling allows our network to learn robust spatiotemporal representations without any high-frame-rate supervision. Our framework is evaluated on UCF101-7 and DAVIS-7 datasets. MiVID is trained entirely on CPU using the datasets and 9-frame video segments, making it a low-resource yet highly effective pipeline. Despite these constraints, our model achieves optimal results at just 50 epochs, competitive with several supervised baselines.This work demonstrates the power of self-supervised diffusion priors for temporally coherent frame synthesis and provides a scalable path toward accessible and generalizable VFI systems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 24 of its 31 references that are in the map. First posted on arXiv 8 Nov 2025.

Builds on

24 of 31 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025TLB-VFI: Temporal-Aware Latent Brownian Bridge Diffusion for Video Frame Interpolation7 Jul
  2. 2025EventDiff: A Unified and Efficient Diffusion Model Framework for Event-based Video Frame Interpolation13 May
  3. 2024Video Interpolation with Diffusion Models1 Apr
  4. 2023MaskINT: Video Editing via Interpolative Non-autoregressive Masked Transformers19 Dec

Other references · 20

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
  4. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
  5. 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 780
  6. 2021Masked Feature Prediction for Self-Supervised Visual Pre-Trainingcited by 573
  7. 2017Future Frame Prediction for Anomaly Detection -- A New Baselinecited by 391
  8. 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 321
  9. 2019Depth-Aware Video Frame Interpolationcited by 232
  10. 2017Video Frame Interpolation via Adaptive Separable Convolutioncited by 211
  11. 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 211
  12. 2018Context-aware Synthesis for Video Frame Interpolationcited by 153
8 more
  1. 2022FILM: Frame Interpolation for Large Motioncited by 149
  2. 2019Quadratic video interpolationcited by 143
  3. 2019AdaCoF: Adaptive Collaboration of Flows for Video Frame Interpolationcited by 133
  4. 2021Video Frame Interpolation Transformercited by 122
  5. 2020FLAVR: Flow-Agnostic Video Representations for Fast Frame Interpolationcited by 97
  6. 2024Disentangled Motion Modeling for Video Frame Interpolationcited by 11
  7. 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolationcited by 8
  8. 2023Self-supervised Learning of Event-guided Video Frame Interpolation for Rolling Shutter Framescited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025EDEN: Enhanced Diffusion for High-quality Large-motion Video Frame Interpolation
  2. 2026Towards Holistic Modeling for Video Frame Interpolation with Auto-regressive Diffusion Transformers
  3. 2024Adapting Image-to-Video Diffusion Models for Large-Motion Frame Interpolation
  4. 2026SPEED: One-Step Pixel Diffusion for High-quality Video Frame Interpolation
  5. 2026FC-VFI: Faithful and Consistent Video Frame Interpolation for High-FPS Slow Motion Video Generation
  6. 2024Motion-aware Latent Diffusion Models for Video Frame Interpolation
  7. 2024Repurposing Pre-trained Video Diffusion Models for Event-based Video Interpolation
  8. 2026SNM-VFI: Symmetric Nonlinear Motion-Guided Generative Video Frame Interpolation