mlsanityData to 7 Oct 2026

LVTINO: LAtent Video consisTency INverse sOlver for High Definition Video Restoration

arXiv 2510.01339 ↗First posted 1 Oct 2025cs.CV stat.MLcited by 2

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Computational imaging methods increasingly rely on powerful generative diffusion models to tackle challenging image restoration tasks. In particular, state-of-the-art zero-shot image inverse solvers leverage distilled text-to-image latent diffusion models (LDMs) to achieve unprecedented accuracy and perceptual quality with high computational efficiency. However, extending these advances to high-definition video restoration remains a significant challenge, due to the need to recover fine spatial detail while capturing subtle temporal dependencies. Consequently, methods that naively apply image-based LDM priors on a frame-by-frame basis often result in temporally inconsistent reconstructions. We address this challenge by leveraging recent advances in Video Consistency Models (VCMs), which distill video latent diffusion models into fast generators that explicitly capture temporal causality. Building on this foundation, we propose LVTINO, the first zero-shot or plug-and-play inverse solver for high definition video restoration with priors encoded by VCMs. Our conditioning mechanism bypasses the need for automatic differentiation and achieves state-of-the-art video reconstruction quality with only a few neural function evaluations, while ensuring strong measurement consistency and smooth temporal transitions across frames. Extensive experiments on a diverse set of video inverse problems show significant perceptual improvements over current state-of-the-art methods that apply image LDMs frame by frame, establishing a new benchmark in both reconstruction fidelity and computational efficiency. The code is available on GitHub.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 61 of its 76 references that are in the map. First posted on arXiv 1 Oct 2025.

Builds on

61 of 76 references.

Closest ancestors · 12

Same direction, newest first

  1. 2025Learning few-step posterior samplers by unfolding and distillation of diffusion models3 Jul
  2. 2025UltraVSR: Achieving Ultra-Realistic Video Super-Resolution with Efficient One-Step Diffusion Space26 May
  3. 2025LATINO-PRO: LAtent consisTency INverse sOlver with PRompt Optimization16 Mar
  4. 2024Zero-Shot Image Restoration Using Few-Step Guidance of Consistency Models (and Beyond)29 Dec
  5. 2024VISION-XL: High Definition Video Inverse Problem Solver using Latent Image Diffusion Models29 Nov
  6. 2024Variational Diffusion Posterior Sampling with Midpoint Guidance13 Oct
  7. 2024PnP-Flow: Plug-and-Play Image Restoration with Flow Matching3 Oct
  8. 2024Solving Video Inverse Problems Using Image Diffusion Models4 Sep
  9. 2024DiffIR2VR-Zero: Zero-Shot Video Restoration with Diffusion-based Image Restoration Models1 Jul
  10. 2024Consistency Model is an Effective Posterior Sample Approximation for Diffusion Inverse Solvers9 Feb
  11. 2022Diffusion Posterior Sampling for General Noisy Inverse Problems29 Sep
  12. 2022Denoising Diffusion Restoration Models27 Jan

Other references · 49

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  6. 2022Scalable Diffusion Models with Transformerscited by 5,931
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  8. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  9. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  10. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  11. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  12. 2022Video Diffusion Modelscited by 2,280
37 more
  1. 2023Consistency Modelscited by 1,778
  2. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  3. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
  4. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  5. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  6. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 835
  7. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
  8. 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 722
  9. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  10. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
  11. 2020Plug-and-Play Image Restoration with Deep Denoiser Priorcited by 467
  12. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
  13. 2023Multisample Flow Matching: Straightening Flows with Minibatch Couplingscited by 267
  14. 2023LCM-LoRA: A Universal Stable-Diffusion Acceleration Modulecited by 211
  15. 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 147
  16. 2017Learning Proximal Operators: Using Denoising Networks for Regularizing Inverse Imaging Problemscited by 107
  17. 2021Gradient Step Denoiser for convergent Plug-and-Playcited by 107
  18. 2021Bayesian imaging using Plug & Play priors: when Langevin meets Tweediecited by 96
  19. 2023VideoLCM: Video Latent Consistency Modelcited by 90
  20. 2023Error Bounds for Flow Matching Methodscited by 88
  21. 2024Optimal Flow Matching: Learning Straight Trajectories in Just One Stepcited by 74
  22. 2018An Online Plug-and-Play Algorithm for Regularized Image Reconstructioncited by 70
  23. 2024Progressive Autoregressive Video Diffusion Modelscited by 65
  24. 2024Fr'echet Video Motion Distance: A Metric for Evaluating Motion Consistency in Videoscited by 54
  25. 2018Split-and-augmented Gibbs sampler - Application to large-scale inference problemscited by 47
  26. 2013Proximal Markov chain Monte Carlo algorithmscited by 46
  27. 2024Improved Video VAE for Latent Video Diffusion Modelcited by 46
  28. 2024Slicedit: Zero-Shot Video Editing With Text-to-Image Diffusion Models Using Spatio-Temporal Slicescited by 40
  29. 2024Motion Consistency Model: Accelerating Video Diffusion with Disentangled Motion-Appearance Distillationcited by 38
  30. 2020Exposure Trajectory Recovery from Motion Blurcited by 31
  31. 2025DeepInverse: A Python package for solving imaging inverse problems with deep learningcited by 27
  32. 2025Dual-Expert Consistency Model for Efficient and High-Quality Video Generationcited by 21
  33. 2023Joint Video Multi-Frame Interpolation and Deblurring under Unknown Exposure Timecited by 16
  34. 2023Provably Convergent Plug-and-Play Quasi-Newton Methodscited by 15
  35. 2024BiM-VFI: Bidirectional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motionscited by 13
  36. 2024Generalized Consistency Trajectory Models for Image Manipulationcited by 11
  37. 2022Video Restoration with a Deep Plug-and-Play Priorcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025TDM: Temporally-Consistent Diffusion Model for All-in-One Real-World Video Restoration
  2. 2025DiTVR: Zero-Shot Diffusion Transformer for Video Restoration
  3. 2025Temporal-Consistent Video Restoration with Pre-trained Diffusion Models
  4. 2024Decoupled Data Consistency with Diffusion Purification for Image Restoration
  5. 2026Zero-Shot Video Restoration and Enhancement with Text-to-Image Latent Diffusion Models and Multi-Modal References
  6. 2025CreativeVR: Diffusion-Prior-Guided Approach for Structure and Motion Restoration in Generative and Real Videos
  7. 2025InstantViR: Real-Time Video Inverse Problem Solver with Distilled Diffusion Prior
  8. 2023Motion-Guided Latent Diffusion for Temporally Consistent Real-world Video Super-resolution