mlsanityData to 14 Oct 2026

Bridging Event Streams and DiT: Event-Guided Video Frame Interpolation

arXiv 2608.10479 ↗First posted 11 Aug 2026cs.CVcited by 0

On the map: Diffusion models → Video generation

Abstract (arXiv)

Latent diffusion models have recently advanced video frame interpolation by synthesizing intermediate frames between input images. However, handling large temporal gaps and complex motion remains challenging, often resulting in motion blur, structural distortions, and temporal inconsistencies. Event cameras provide high-temporal-resolution motion cues that are well suited for bridging these gaps and improving interpolation quality. To exploit this advantage without training an event-assisted model from scratch, we propose an adapter-based framework that incorporates event-derived cues into a pre-trained image-to-video diffusion model with minimal architectural changes. Specifically, our method leverages Image Warped Events (IWEs) and bidirectional sparse optical flow to provide spatially and temporally aligned guidance during generation. By injecting these event-guided structural and motion cues into the diffusion process, our approach reduces interpolation artifacts and improves both reconstruction fidelity and temporal coherence. Experimental results on real and synthetic benchmarks show that our method consistently outperforms existing state-of-the-art approaches. The project page is at https://joseph-lin-tech.github.io/BridgeEventDiT-VFI/.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 20 of its 34 references that are in the map. First posted on arXiv 11 Aug 2026.

Builds on

20 of 34 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noise14 Jan
  2. 2024Repurposing Pre-trained Video Diffusion Models for Event-based Video Interpolation10 Dec
  3. 2024ViBiDSampler: Enhancing Video Interpolation Using Bidirectional Diffusion Sampler8 Oct
  4. 2024Generative Inbetweening: Adapting Image-to-Video Models for Keyframe Interpolation27 Aug
  5. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  6. 2022MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolation19 May

Other references · 14

  1. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
  2. 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 225
  3. 2017Video Frame Interpolation via Adaptive Separable Convolutioncited by 213
  4. 2020TransNet V2: An effective deep network architecture for fast shot transition detectioncited by 171
  5. 2019Video to Events: Recycling Video Datasets for Event Camerascited by 165
  6. 2021TimeLens: Event-based Video Frame Interpolationcited by 151
  7. 2022IFRNet: Intermediate Feature Refine Network for Efficient Frame Interpolationcited by 109
  8. 2022Unifying Motion Deblurring and Frame Interpolation with Eventscited by 58
  9. 2022TimeReplayer: Unlocking the Potential of Event Cameras for Video Interpolationcited by 37
  10. 2025Event-Based Video Frame Interpolation With Cross-Modal Asymmetric Bidirectional Motion Fieldscited by 25
  11. 2024Generative Inbetweening through Frame-wise Conditions-Driven Video Generationcited by 24
  12. 2024Frame Interpolation with Consecutive Brownian Bridge Diffusioncited by 19
2 more
  1. 2024DreamMover: Leveraging the Prior of Diffusion Models for Image Interpolation with Large Motioncited by 16
  2. 2024Secrets of Edge-Informed Contrast Maximization for Event-Based Visioncited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025EventDiff: A Unified and Efficient Diffusion Model Framework for Event-based Video Frame Interpolation
  2. 2025DESSERT: Diffusion-based Event-driven Single-frame Synthesis via Residual Training
  3. 2026UniE2F: A Unified Diffusion Framework for Event-to-Frame Reconstruction with Video Foundation Models
  4. 2025EGVD: Event-Guided Video Diffusion Model for Physically Realistic Large-Motion Frame Interpolation
  5. 2024Temporal Residual Guided Diffusion Framework for Event-Driven Video Reconstruction
  6. 2026LongE2V: Long-Horizon Event-based Video Reconstruction, Prediction, and Frame Interpolation with Video Diffusion Models
  7. 2025EDEN: Enhanced Diffusion for High-quality Large-motion Video Frame Interpolation
  8. 2024E2VIDiff: Perceptual Events-to-Video Reconstruction using Diffusion Priors