mlsanityData to 14 Oct 2026

Arbitrary Generative Video Interpolation

arXiv 2510.00578 ↗First posted 1 Oct 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Video frame interpolation (VFI), which generates intermediate frames from given start and end frames, has become a fundamental function in video generation applications. However, existing generative VFI methods are constrained to synthesize a fixed number of intermediate frames, lacking the flexibility to adjust generated frame rates or total sequence duration. In this work, we present ArbInterp, a novel generative VFI framework that enables efficient interpolation at any timestamp and of any length. Specifically, to support interpolation at any timestamp, we propose the Timestamp-aware Rotary Position Embedding (TaRoPE), which modulates positions in temporal RoPE to align generated frames with target normalized timestamps. This design enables fine-grained control over frame timestamps, addressing the inflexibility of fixed-position paradigms in prior work. For any-length interpolation, we decompose long-sequence generation into segment-wise frame synthesis. We further design a novel appearance-motion decoupled conditioning strategy: it leverages prior segment endpoints to enforce appearance consistency and temporal semantics to maintain motion coherence, ensuring seamless spatiotemporal transitions across segments. Experimentally, we build comprehensive benchmarks for multi-scale frame interpolation (2x to 32x) to assess generalizability across arbitrary interpolation factors. Results show that ArbInterp outperforms prior methods across all scenarios with higher fidelity and more seamless spatiotemporal continuity. Project website: https://mcg-nju.github.io/ArbInterp-Web/.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 43 of its 53 references that are in the map. First posted on arXiv 1 Oct 2025.

Builds on

43 of 53 references.

References · 43

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  4. 2022Scalable Diffusion Models with Transformerscited by 6,054
  5. 2022Flow Matching for Generative Modelingcited by 5,702
  6. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  7. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  8. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  9. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  10. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  11. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  12. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
31 more
  1. 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,492
  2. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
  3. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  4. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
  5. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  6. 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 484
  7. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
  8. 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 450
  9. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
  10. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
  11. 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 251
  12. 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 213
  13. 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDEcited by 178
  14. 2023NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generationcited by 171
  15. 2022FILM: Frame Interpolation for Large Motioncited by 153
  16. 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 137
  17. 2024Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiTcited by 132
  18. 2021XVFI: eXtreme Video Frame Interpolationcited by 126
  19. 2025Long Context Tuning for Video Generationcited by 113
  20. 2023LDMVFI: Video Frame Interpolation with Latent Diffusion Modelscited by 89
  21. 2023ARTboldsymbol·V: Auto-Regressive Text-to-Video Generation with Diffusion Modelscited by 76
  22. 2024Allegro: Open the Black Box of Commercial-Level Video Generation Modelcited by 70
  23. 2024Video Interpolation with Diffusion Modelscited by 68
  24. 2024ToonCrafter: Generative Cartoon Interpolationcited by 68
  25. 2025Goku: Flow Based Video Generative Foundation Modelscited by 67
  26. 2025RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformerscited by 66
  27. 2024CreatiLayout: Siamese Multimodal Diffusion Transformer for Creative Layout-to-Image Generationcited by 60
  28. 2024Generative Inbetweening: Adapting Image-to-Video Models for Keyframe Interpolationcited by 44
  29. 2024Mind the Time: Temporally-Controlled Multi-Event Video Generationcited by 40
  30. 2024Explorative Inbetweening of Time and Spacecited by 21
  31. 2025Motion-Aware Generative Frame Interpolationcited by 13

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.