mlsanityData to 14 Oct 2026

Destination-Conditioned Adaptation with Semantic-Geometric Alignment for Generative Inbetweening

arXiv 2610.13187 ↗First posted 9 Oct 2026cs.CVcited by 0

On the map: Diffusion models → Video generation

Abstract (arXiv)

Generative inbetweening aims to synthesize temporally coherent intermediate frames between a start frame and a target frame. Although pretrained image-to-video diffusion models provide strong priors for large-motion inbetweening, they are not explicitly designed to reach a specified target frame. They may therefore generate realistic individual frames while drifting from the target or producing unstable motion under large displacements and non-rigid dynamics. We propose DSG-GI, a framework that adapts pretrained latent video diffusion models through Destination-Conditioned Adaptation and Semantic-Geometric Alignment. Destination-Conditioned Adaptation treats the target frame as the destination of the sequence and provides temporally progressive guidance along the generated trajectory. Semantic-Geometric Alignment aligns the token-wise spatio-temporal relational geometry of backbone features with that of a frozen video foundation encoder and applies a flow-matching-aware latent flow constraint to samples near the data endpoint of the probability path. Together, these components strengthen destination guidance and preserve coherent semantic-geometric motion structure. Extensive experiments on standard and large-motion inbetweening benchmarks demonstrate improvements in temporal stability, target-frame faithfulness, and perceptual quality. Our code will be made publicly available.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 43 of its 50 references that are in the map. First posted on arXiv 9 Oct 2026.

Builds on

43 of 50 references.

Closest ancestors · 14

Same direction, newest first

  1. 2026SPEED: One-Step Pixel Diffusion for High-quality Video Frame Interpolation17 Jul
  2. 2026Motion Prior Distillation in Time Reversal Sampling for Generative Inbetweening13 Feb
  3. 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Models29 May
  4. 2024ViBiDSampler: Enhancing Video Interpolation Using Bidirectional Diffusion Sampler8 Oct
  5. 2024Generative Inbetweening: Adapting Image-to-Video Models for Keyframe Interpolation27 Aug
  6. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  7. 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generation31 Jul
  8. 2024Ctrl-Adapter: An Efficient and Versatile Framework for Adapting Diverse Controls to Any Diffusion Model15 Apr
  9. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generation2 Apr
  10. 2024Video Interpolation with Diffusion Models1 Apr
  11. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  12. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
2 more
  1. 2023LDMVFI: Video Frame Interpolation with Latent Diffusion Models16 Mar
  2. 2022MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolation19 May

Other references · 29

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  5. 2022Scalable Diffusion Models with Transformerscited by 6,054
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  7. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  8. 2025Qwen3-VL Technical Reportcited by 2,793
  9. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  10. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  11. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  12. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
17 more
  1. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
  2. 2023VideoMAE V2: Scaling Video Masked Autoencoders with Dual Maskingcited by 528
  3. 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 326
  4. 2020Softmax Splatting for Video Frame Interpolationcited by 279
  5. 2019Depth-Aware Video Frame Interpolationcited by 234
  6. 2017Video Frame Interpolation via Adaptive Separable Convolutioncited by 213
  7. 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
  8. 2024ControlNeXt: Powerful and Efficient Control for Image and Video Generationcited by 159
  9. 2022FILM: Frame Interpolation for Large Motioncited by 153
  10. 2021XVFI: eXtreme Video Frame Interpolationcited by 126
  11. 2022IFRNet: Intermediate Feature Refine Network for Efficient Frame Interpolationcited by 109
  12. 2023Extracting Motion and Appearance via Inter-Frame Attention for Efficient Video Frame Interpolationcited by 98
  13. 2024Fr'echet Video Motion Distance: A Metric for Evaluating Motion Consistency in Videoscited by 58
  14. 2024Sparse Global Matching for Video Frame Interpolation with Large Motioncited by 28
  15. 2024Generative Inbetweening through Frame-wise Conditions-Driven Video Generationcited by 24
  16. 2025EF-VI: Enhancing End-Frame Injection for Video Inbetweeningcited by 4
  17. 2026Anchoring and Rescaling Attention for Semantically Coherent Inbetweeningcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SHIFT: Motion Alignment in Video Diffusion Models with Adversarial Hybrid Fine-Tuning
  2. 2026VIGOR: VIdeo Geometry-Oriented Reward for Temporal Generative Alignment
  3. 2025MoAlign: Motion-Centric Representation Alignment for Video Diffusion Models
  4. 2025From Generation to Generalization: Emergent Few-Shot Learning in Video Diffusion Models
  5. 2026Generative Motion In-betweening by Diffusion over Continuous Implicit Representations
  6. 2026Can Video Diffusion Models Predict Past Frames? Bidirectional Cycle Consistency for Reversible Interpolation
  7. 2026VGGRPO: Towards World-Consistent Video Generation with 4D Latent Reward
  8. 2025Structure From Tracking: Distilling Structure-Preserving Motion for Video Generation