Arbitrary Generative Video Interpolation
Not on the map. Why?
Abstract (arXiv)
Video frame interpolation (VFI), which generates intermediate frames from given start and end frames, has become a fundamental function in video generation applications. However, existing generative VFI methods are constrained to synthesize a fixed number of intermediate frames, lacking the flexibility to adjust generated frame rates or total sequence duration. In this work, we present ArbInterp, a novel generative VFI framework that enables efficient interpolation at any timestamp and of any length. Specifically, to support interpolation at any timestamp, we propose the Timestamp-aware Rotary Position Embedding (TaRoPE), which modulates positions in temporal RoPE to align generated frames with target normalized timestamps. This design enables fine-grained control over frame timestamps, addressing the inflexibility of fixed-position paradigms in prior work. For any-length interpolation, we decompose long-sequence generation into segment-wise frame synthesis. We further design a novel appearance-motion decoupled conditioning strategy: it leverages prior segment endpoints to enforce appearance consistency and temporal semantics to maintain motion coherence, ensuring seamless spatiotemporal transitions across segments. Experimentally, we build comprehensive benchmarks for multi-scale frame interpolation (2x to 32x) to assess generalizability across arbitrary interpolation factors. Results show that ArbInterp outperforms prior methods across all scenarios with higher fidelity and more seamless spatiotemporal continuity. Project website: https://mcg-nju.github.io/ArbInterp-Web/.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 43 of its 53 references that are in the map. First posted on arXiv 1 Oct 2025.
Builds on
43 of 53 references.
References · 43
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
31 more
- 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,492
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 484
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 450
- 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
- 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 251
- 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 213
- 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDEcited by 178
- 2023NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generationcited by 171
- 2022FILM: Frame Interpolation for Large Motioncited by 153
- 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 137
- 2024Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiTcited by 132
- 2021XVFI: eXtreme Video Frame Interpolationcited by 126
- 2025Long Context Tuning for Video Generationcited by 113
- 2023LDMVFI: Video Frame Interpolation with Latent Diffusion Modelscited by 89
- 2023ARTboldsymbol·V: Auto-Regressive Text-to-Video Generation with Diffusion Modelscited by 76
- 2024Allegro: Open the Black Box of Commercial-Level Video Generation Modelcited by 70
- 2024Video Interpolation with Diffusion Modelscited by 68
- 2024ToonCrafter: Generative Cartoon Interpolationcited by 68
- 2025Goku: Flow Based Video Generative Foundation Modelscited by 67
- 2025RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformerscited by 66
- 2024CreatiLayout: Siamese Multimodal Diffusion Transformer for Creative Layout-to-Image Generationcited by 60
- 2024Generative Inbetweening: Adapting Image-to-Video Models for Keyframe Interpolationcited by 44
- 2024Mind the Time: Temporally-Controlled Multi-Event Video Generationcited by 40
- 2024Explorative Inbetweening of Time and Spacecited by 21
- 2025Motion-Aware Generative Frame Interpolationcited by 13
Built on by
Citing papers per year: 2026: 1.
1 paper.