SAGE: Structure-Aware Generative Video Transitions between Diverse Clips
Not on the map. Why?
Abstract (arXiv)
Video transitions aim to synthesize intermediate frames between two clips, but naive approaches such as linear blending introduce artifacts that limit professional use or break temporal coherence. Traditional techniques (cross-fades, morphing, frame interpolation) and recent generative inbetweening methods can produce high-quality plausible intermediates, but they struggle with bridging diverse clips involving large temporal gaps or significant semantic differences, leaving a gap for content-aware and visually coherent transitions. We address this challenge by drawing on artistic workflows, distilling strategies such as aligning silhouettes and interpolating salient features to preserve structure and perceptual continuity. Building on these strategies, we propose SAGE (Structure-Aware Generative vidEo transitions) as a simple yet effective zeroshot approach that combines structural guidance, provided via line maps and motion flow, with generative synthesis, enabling smooth, motion-consistent transitions without fine-tuning. Extensive experiments and comparison with current alternatives, namely [FILM, TVG, DiffMorpher, VACE, GI], demonstrate that SAGE outperforms both classical and the latest generative baselines on quantitative metrics and user studies for producing transitions between diverse clips. The simple method effectively bypasses the need to acquire suitable training data, which is particularly difficult in our creative setting involving diverse clips. Code is available via the project page at https://kan32501.github.io/sage.github.io/.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 16 of its 24 references that are in the map. First posted on arXiv 28 Oct 2025.
Builds on
16 of 24 references.
References · 16
- 2023Segment Anythingcited by 8,234
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2019Depth-Aware Video Frame Interpolationcited by 234
- 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 233
- 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 174
- 2022FILM: Frame Interpolation for Large Motioncited by 153
- 2024Video Interpolation with Diffusion Modelscited by 68
- 2023DiffMorpher: Unleashing the Capability of Diffusion Models for Image Morphingcited by 67
- 2023GlueStick: Robust Image Matching by Sticking Points and Lines Togethercited by 66
- 2023Diffusion 3D Features (Diff3F): Decorating Untextured Shapes with Distilled Semantic Featurescited by 55
- 2024Generative Inbetweening through Frame-wise Conditions-Driven Video Generationcited by 24
- 2025EDEN: Enhanced Diffusion for High-quality Large-motion Video Frame Interpolationcited by 19
4 more
- 2024TVG: A Training-free Transition Video Generation Method with Diffusion Modelscited by 15
- 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolationcited by 9
- 2025Versatile Transition Generation with Image-to-Video Diffusioncited by 7
- 2024MatchDiffusion: Training-free Generation of Match-cutscited by 5
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.