mlsanityData to 7 Oct 2026

LAVIB: A Large-scale Video Interpolation Benchmark

arXiv 2406.09754 ↗First posted 14 Jun 2024cs.CVcited by 11

Not on the map. Why?

Abstract (arXiv)

This paper introduces a LArge-scale Video Interpolation Benchmark (LAVIB) for the low-level video task of Video Frame Interpolation (VFI). LAVIB comprises a large collection of high-resolution videos sourced from the web through an automated pipeline with minimal requirements for human verification. Metrics are computed for each video's motion magnitudes, luminance conditions, frame sharpness, and contrast. The collection of videos and the creation of quantitative challenges based on these metrics are under-explored by current low-level video task datasets. In total, LAVIB includes 283K clips from 17K ultra-HD videos, covering 77.6 hours. Benchmark train, val, and test sets maintain similar video metric distributions. Further splits are also created for out-of-distribution (OOD) challenges, with train and test splits including videos of dissimilar attributes.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 48 of its 82 references that are in the map. First posted on arXiv 14 Jun 2024.

Builds on

48 of 82 references.

References · 48

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  3. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
  4. 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 722
  5. 2017Video Enhancement with Task-Oriented Flowcited by 612
  6. 2022Masked Autoencoders As Spatiotemporal Learnerscited by 428
  7. 2019DeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Bettercited by 361
  8. 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 340
  9. 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 321
  10. 2020Softmax Splatting for Video Frame Interpolationcited by 276
  11. 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 273
  12. 2019Depth-Aware Video Frame Interpolationcited by 232
36 more
  1. 2022VRT: A Video Restoration Transformercited by 219
  2. 2017Video Frame Interpolation via Adaptive Separable Convolutioncited by 211
  3. 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 211
  4. 2022Recurrent Video Restoration Transformer with Guided Deformable Attentioncited by 168
  5. 2019Quality Assessment of In-the-Wild Videoscited by 164
  6. 2022FILM: Frame Interpolation for Large Motioncited by 149
  7. 2017Detail-revealing Deep Video Super-resolutioncited by 147
  8. 2018AdaFrame: Adaptive Frame Selection for Fast Video Recognitioncited by 134
  9. 2021XVFI: eXtreme Video Frame Interpolationcited by 123
  10. 2015A Novel Performance Evaluation Methodology for Single-Target Trackerscited by 113
  11. 2021Asymmetric Bilateral Motion Estimation for Video Frame Interpolationcited by 101
  12. 2020FLAVR: Flow-Agnostic Video Representations for Fast Frame Interpolationcited by 97
  13. 2023Extracting Motion and Appearance via Inter-Frame Attention for Efficient Video Frame Interpolationcited by 97
  14. 2022Rethinking Alignment in Video Super-Resolution Transformerscited by 71
  15. 2021Deep Animation Video Interpolation in the Wildcited by 65
  16. 2019DVDnet: A Fast Network for Deep Video Denoisingcited by 60
  17. 2021CDFI: Compression-Driven Network Design for Frame Interpolationcited by 55
  18. 2021AdaPool: Exponential Adaptive Pooling for Information-Retaining Downsamplingcited by 47
  19. 2020Unsupervised Deep Video Denoisingcited by 44
  20. 2020Deep Video Super-Resolution using HR Optical Flow Estimationcited by 40
  21. 2020A Loss Function for Generative Neural Networks Based on Watson's Perceptual Modelcited by 39
  22. 2022A Unified Pyramid Recurrent Network for Video Frame Interpolationcited by 39
  23. 2021Dynamic Network Quantization for Efficient Video Inferencecited by 36
  24. 2021COMISR: Compression-Informed Video Super-Resolutioncited by 26
  25. 2022Neural Compression-Based Feature Learning for Video Restorationcited by 23
  26. 2022Look Back and Forth: Video Super-Resolution with Explicit Temporal Difference Modelingcited by 20
  27. 2022AdaFocusV3: On Unified Spatial-temporal Dynamic Video Recognitioncited by 18
  28. 2020DeFMO: Deblurring and Shape Recovery of Fast Moving Objectscited by 16
  29. 2022NSNet: Non-saliency Suppression Sampler for Efficient Video Recognitioncited by 15
  30. 2022A Perceptual Quality Metric for Video Frame Interpolationcited by 15
  31. 2022Learning Cross-Video Neural Representations for High-Quality Frame Interpolationcited by 11
  32. 2021Moving SLAM: Fully Unsupervised Deep Learning in Non-Rigid Scenescited by 8
  33. 2022Rethinking Resolution in the Context of Efficient Video Recognitioncited by 8
  34. 2022You Only Align Once: Bidirectional Interaction for Spatial-Temporal Video Super-Resolutioncited by 3
  35. 2023ResQ: Residual Quantization for Video Perceptioncited by 2
  36. 2023Implicit View-Time Interpolation of Stereo Videos using Multi-Plane Disparities and Non-Uniform Coordinatescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 6; 2026: 5.

11 papers.

  1. 2025EDEN: Enhanced Diffusion for High-quality Large-motion Video Frame Interpolationcited by 19
  2. 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolationcited by 8
  3. 2025VFRTok: Variable Frame Rates Video Tokenizer with Duration-Proportional Information Assumptioncited by 4
  4. 2025Controllable Human-centric Keyframe Interpolation with Generative Priorcited by 4
  5. 2026Towards Holistic Modeling for Video Frame Interpolation with Auto-regressive Diffusion Transformerscited by 4
  6. 2026Uni-LVC: A Unified Method for Intra- and Inter-Mode Learned Video Compressioncited by 1
  7. 2026Anchoring and Rescaling Attention for Semantically Coherent Inbetweeningcited by 1
  8. 2026SPEED: One-Step Pixel Diffusion for High-quality Video Frame Interpolationcited by 1
  9. 2025Decoupling Complexity from Scale in Latent Diffusion Modelcited by 0
  10. 2025TRANSPORTER: Transferring Visual Semantics from VLM Manifoldscited by 0
  11. 2026A Self-Supervised Learning Framework for Video Encoding Complexity Clusteringcited by 0