mlsanityData to 14 Oct 2026

DA-Flow: Degradation-Aware Optical Flow Estimation with Diffusion Models

arXiv 2603.23499 ↗First posted 24 Mar 2026cs.CVcited by 0

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Optical flow models trained on high-quality data often degrade severely when confronted with real-world corruptions such as blur, noise, and compression artifacts. To overcome this limitation, we formulate Degradation-Aware Optical Flow, a new task targeting accurate dense correspondence estimation from real-world corrupted videos. Our key insight is that the intermediate representations of image restoration diffusion models are inherently corruption-aware but lack temporal awareness. To address this limitation, we lift the model to attend across adjacent frames via full spatio-temporal attention, and empirically demonstrate that the resulting features exhibit zero-shot correspondence capabilities. Based on this finding, we present DA-Flow, a hybrid architecture that fuses these diffusion features with convolutional features within an iterative refinement framework. DA-Flow substantially outperforms existing optical flow methods under severe degradation across multiple benchmarks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 34 of its 45 references that are in the map. First posted on arXiv 24 Mar 2026.

Builds on

34 of 45 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025DOVE: Efficient One-Step Diffusion Model for Real-World Video Super-Resolution22 May
  2. 2025DiT4SR: Taming Diffusion Transformer for Real-World Image Super-Resolution30 Mar
  3. 2025STAR: Spatial-Temporal Augmentation with Text-to-Video Models for Real-World Video Super-Resolution6 Jan
  4. 2024DreamClear: High-Capacity Real-World Image Restoration with Privacy-Safe Dataset Curation24 Oct
  5. 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolution11 Dec
  6. 2023Motion-Guided Latent Diffusion for Temporally Consistent Real-world Video Super-resolution1 Dec
  7. 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolution27 Nov

Other references · 27

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  2. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  3. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  4. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  5. 2022Video Diffusion Modelscited by 2,305
  6. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
  7. 2021Vision Transformers for Dense Predictioncited by 1,803
  8. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  9. 2021Image Super-Resolution via Iterative Refinementcited by 1,511
  10. 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
  11. 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
  12. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
15 more
  1. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
  2. 2023Emergent Correspondence from Image Diffusioncited by 446
  3. 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 301
  4. 2017Working hard to know your neighbor's margins: Local descriptor learning losscited by 212
  5. 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 174
  6. 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 172
  7. 2021Investigating Tradeoffs in Real-World Video Super-Resolutioncited by 134
  8. 2023Diffuse, Attend, and Segment: Unsupervised Zero-Shot Segmentation using Stable Diffusioncited by 131
  9. 2025Marigold: Affordable Adaptation of Diffusion-Based Image Generators for Image Analysiscited by 78
  10. 2025Emergent Temporal Correspondences from Video Diffusion Transformerscited by 31
  11. 2025Seg4Diff: Unveiling Open-Vocabulary Segmentation in Text-to-Image Diffusion Transformerscited by 24
  12. 2025Unleashing Diffusion Transformers for Visual Correspondence by Modulating Massive Activationscited by 23
  13. 2023Diffusion Model for Dense Matchingcited by 21
  14. 2025FlowSeek: Optical Flow Made Easier with Depth Foundation Models and Motion Basescited by 10
  15. 2025RobustSpring: Benchmarking Robustness to Image Corruptions for Optical Flow, Scene Flow and Stereocited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026D2-VR: Degradation-Robust and Distilled Video Restoration with Synergistic Optimization Strategy
  2. 2025DiTVR: Zero-Shot Diffusion Transformer for Video Restoration
  3. 2025Injecting Frame-Event Complementary Fusion into Diffusion for Optical Flow in Challenging Scenes
  4. 2024DiffIR2VR-Zero: Zero-Shot Video Restoration with Diffusion-based Image Restoration Models
  5. 2025DiffVSR: Revealing an Effective Recipe for Taming Robust Video Super-Resolution Against Complex Degradations
  6. 2023FlowVid: Taming Imperfect Optical Flows for Consistent Video-to-Video Synthesis
  7. 2026Learning When to Denoise: Optimizing Asynchronous Schedules for Latent Diffusion
  8. 2026Flow Map Denoisers: Traversing the Distortion-Perception Plane for Inverse Problems