mlsanityData to 14 Oct 2026

SparkVSR: Interactive Video Super-Resolution via Sparse Keyframe Propagation

arXiv 2603.16864 ↗First posted 17 Mar 2026cs.CV cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

Video Super-Resolution (VSR) aims to restore high-quality video frames from low-resolution (LR) estimates, yet most existing VSR approaches behave like black boxes at inference time: users cannot reliably correct unexpected artifacts, but instead can only accept whatever the model produces. In this paper, we propose a novel interactive VSR framework dubbed SparkVSR that makes sparse keyframes a simple and expressive control signal. Specifically, users can first super-resolve or optionally a small set of keyframes using any off-the-shelf image super-resolution (ISR) model, then SparkVSR propagates the keyframe priors to the entire video sequence while remaining grounded by the original LR video motion. Concretely, we introduce a keyframe-conditioned latent-pixel two-stage training pipeline that fuses LR video latents with sparsely encoded HR keyframe latents to learn robust cross-space propagation and refine perceptual details. At inference time, SparkVSR supports flexible keyframe selection (manual specification, codec I-frame extraction, or random sampling) and a reference-free guidance mechanism that continuously balances keyframe adherence and blind restoration, ensuring robust performance even when reference keyframes are absent or imperfect. Experiments on multiple VSR benchmarks demonstrate improved temporal consistency and strong restoration quality, surpassing baselines by up to 24.6%, 21.8%, and 5.6% on CLIP-IQA, DOVER, and MUSIQ, respectively, enabling controllable, keyframe-driven video super-resolution. Moreover, we demonstrate that SparkVSR is a generic interactive, keyframe-conditioned video processing framework as it can be applied out of the box to unseen tasks such as old-film restoration and video style transfer. Our project page is available at: https://sparkvsr.github.io/

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 57 of its 68 references that are in the map. First posted on arXiv 17 Mar 2026.

Builds on

57 of 68 references.

References · 57

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  4. 2022Classifier-Free Diffusion Guidancecited by 5,847
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  6. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  8. 2022Video Diffusion Modelscited by 2,305
  9. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  10. 2017Decoupled Weight Decay Regularizationcited by 1,831
  11. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  12. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
38 more
  1. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
  2. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
  3. 2021Video Swin Transformercited by 1,091
  4. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
  5. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
  6. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
  7. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  8. 2017The Perception-Distortion Tradeoffcited by 587
  9. 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 494
  10. 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 489
  11. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
  12. 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 465
  13. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
  14. 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 403
  15. 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 342
  16. 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
  17. 2020BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyondcited by 304
  18. 2018Learning Blind Video Temporal Consistencycited by 253
  19. 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 246
  20. 2018TDAN: Temporally Deformable Alignment Network for Video Super-Resolutioncited by 226
  21. 2022VRT: A Video Restoration Transformercited by 220
  22. 2022Recurrent Video Restoration Transformer with Guided Deformable Attentioncited by 170
  23. 2017Detail-revealing Deep Video Super-resolutioncited by 148
  24. 2020UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Contentcited by 140
  25. 2021Investigating Tradeoffs in Real-World Video Super-Resolutioncited by 134
  26. 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolutioncited by 132
  27. 2021RAPIQUE: Rapid and Accurate Video Quality Prediction of User Generated Contentcited by 100
  28. 2024Pixel-level and Semantic-level Adjustable Super-resolution: A Dual-LoRA Approachcited by 97
  29. 2020MuCAN: Multi-Correspondence Aggregation Network for Video Super-Resolutioncited by 89
  30. 2020Video Super-resolution with Temporal Group Attentioncited by 81
  31. 2025SeedVR: Seeding Infinity in Diffusion Transformer Towards Generic Video Restorationcited by 62
  32. 2025STAR: Spatial-Temporal Augmentation with Text-to-Video Models for Real-World Video Super-Resolutioncited by 56
  33. 2022Neighbourhood Representative Sampling for Efficient End-to-end Video Quality Assessmentcited by 50
  34. 2025SeedVR2: One-Step Video Restoration via Diffusion Adversarial Post-Trainingcited by 50
  35. 2025FlashVSR: Towards Real-Time Diffusion-Based Streaming Video Super-Resolutioncited by 43
  36. 2024Generative Video Propagationcited by 36
  37. 20254KAgent: Agentic Any Image to 4K Super-Resolutioncited by 36
  38. 2025DOVE: Efficient One-Step Diffusion Model for Real-World Video Super-Resolutioncited by 31

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.