SparkVSR: Interactive Video Super-Resolution via Sparse Keyframe Propagation
Not on the map. Why?
Abstract (arXiv)
Video Super-Resolution (VSR) aims to restore high-quality video frames from low-resolution (LR) estimates, yet most existing VSR approaches behave like black boxes at inference time: users cannot reliably correct unexpected artifacts, but instead can only accept whatever the model produces. In this paper, we propose a novel interactive VSR framework dubbed SparkVSR that makes sparse keyframes a simple and expressive control signal. Specifically, users can first super-resolve or optionally a small set of keyframes using any off-the-shelf image super-resolution (ISR) model, then SparkVSR propagates the keyframe priors to the entire video sequence while remaining grounded by the original LR video motion. Concretely, we introduce a keyframe-conditioned latent-pixel two-stage training pipeline that fuses LR video latents with sparsely encoded HR keyframe latents to learn robust cross-space propagation and refine perceptual details. At inference time, SparkVSR supports flexible keyframe selection (manual specification, codec I-frame extraction, or random sampling) and a reference-free guidance mechanism that continuously balances keyframe adherence and blind restoration, ensuring robust performance even when reference keyframes are absent or imperfect. Experiments on multiple VSR benchmarks demonstrate improved temporal consistency and strong restoration quality, surpassing baselines by up to 24.6%, 21.8%, and 5.6% on CLIP-IQA, DOVER, and MUSIQ, respectively, enabling controllable, keyframe-driven video super-resolution. Moreover, we demonstrate that SparkVSR is a generic interactive, keyframe-conditioned video processing framework as it can be applied out of the box to unseen tasks such as old-film restoration and video style transfer. Our project page is available at: https://sparkvsr.github.io/
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 57 of its 68 references that are in the map. First posted on arXiv 17 Mar 2026.
Builds on
57 of 68 references.
References · 57
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2022Video Diffusion Modelscited by 2,305
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2017Decoupled Weight Decay Regularizationcited by 1,831
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
38 more
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
- 2021Video Swin Transformercited by 1,091
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
- 2017The Perception-Distortion Tradeoffcited by 587
- 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 494
- 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 489
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
- 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 465
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
- 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 403
- 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 342
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
- 2020BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyondcited by 304
- 2018Learning Blind Video Temporal Consistencycited by 253
- 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 246
- 2018TDAN: Temporally Deformable Alignment Network for Video Super-Resolutioncited by 226
- 2022VRT: A Video Restoration Transformercited by 220
- 2022Recurrent Video Restoration Transformer with Guided Deformable Attentioncited by 170
- 2017Detail-revealing Deep Video Super-resolutioncited by 148
- 2020UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Contentcited by 140
- 2021Investigating Tradeoffs in Real-World Video Super-Resolutioncited by 134
- 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolutioncited by 132
- 2021RAPIQUE: Rapid and Accurate Video Quality Prediction of User Generated Contentcited by 100
- 2024Pixel-level and Semantic-level Adjustable Super-resolution: A Dual-LoRA Approachcited by 97
- 2020MuCAN: Multi-Correspondence Aggregation Network for Video Super-Resolutioncited by 89
- 2020Video Super-resolution with Temporal Group Attentioncited by 81
- 2025SeedVR: Seeding Infinity in Diffusion Transformer Towards Generic Video Restorationcited by 62
- 2025STAR: Spatial-Temporal Augmentation with Text-to-Video Models for Real-World Video Super-Resolutioncited by 56
- 2022Neighbourhood Representative Sampling for Efficient End-to-end Video Quality Assessmentcited by 50
- 2025SeedVR2: One-Step Video Restoration via Diffusion Adversarial Post-Trainingcited by 50
- 2025FlashVSR: Towards Real-Time Diffusion-Based Streaming Video Super-Resolutioncited by 43
- 2024Generative Video Propagationcited by 36
- 20254KAgent: Agentic Any Image to 4K Super-Resolutioncited by 36
- 2025DOVE: Efficient One-Step Diffusion Model for Real-World Video Super-Resolutioncited by 31
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026SmartDirector: Keyframe-Conditioned Cinematic Video Generation with Narrative Pacing Controlcited by 2
- 20264KLSDB: A Large-Scale Dataset for 4K Image Restoration and Generationcited by 1
- 2026DreamX-Creator: Democratizing Native Audio-Video Generation at 2K Resolutioncited by 0
- 2026RelayVSR: Large-Small Model Collaboration for Efficient Real-World Video Super-Resolutioncited by 0
- 2026ViTeX-Bench: Benchmarking High-Fidelity Video Scene Text Editingcited by 0
- 2026ViTeX-Bench: Benchmarking High-Fidelity Video Scene Text Editing30 Sep 2026
- 2026RelayVSR: Large-Small Model Collaboration for Efficient Real-World Video Super-Resolution29 Sep 2026
- 2026DreamX-Creator: Democratizing Native Audio-Video Generation at 2K Resolution31 Aug 2026
- 2026SmartDirector: Keyframe-Conditioned Cinematic Video Generation with Narrative Pacing Control27 May 2026
- 20264KLSDB: A Large-Scale Dataset for 4K Image Restoration and Generation23 May 2026