Towards Blind Bitstream-corrupted Video Recovery via a Visual Foundation Model-driven Framework
Not on the map. Why?
Abstract (arXiv)
Video signals are vulnerable in multimedia communication and storage systems, as even slight bitstream-domain corruption can lead to significant pixel-domain degradation. To recover faithful spatio-temporal content from corrupted inputs, bitstream-corrupted video recovery has recently emerged as a challenging and understudied task. However, existing methods require time-consuming and labor-intensive annotation of corrupted regions for each corrupted video frame, resulting in a large workload in practice. In addition, high-quality recovery remains difficult as part of the local residual information in corrupted frames may mislead feature completion and successive content recovery. In this paper, we propose the first blind bitstream-corrupted video recovery framework that integrates visual foundation models with a recovery model, which is adapted to different types of corruption and bitstream-level prompts. Within the framework, the proposed Detect Any Corruption (DAC) model leverages the rich priors of the visual foundation model while incorporating bitstream and corruption knowledge to enhance corruption localization and blind recovery. Additionally, we introduce a novel Corruption-aware Feature Completion (CFC) module, which adaptively processes residual contributions based on high-level corruption understanding. With VFM-guided hierarchical feature augmentation and high-level coordination in a mixture-of-residual-experts (MoRE) structure, our method suppresses artifacts and enhances informative residuals. Comprehensive evaluations show that the proposed method achieves outstanding performance in bitstream-corrupted video recovery without requiring a manually labeled mask sequence. The demonstrated effectiveness will help to realize improved user experience, wider application scenarios, and more reliable multimedia communication and storage systems.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 26 of its 51 references that are in the map. First posted on arXiv 30 Jul 2025.
Builds on
26 of 51 references.
References · 26
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
- 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 494
- 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 425
- 2023Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistlescited by 290
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
14 more
- 2020Learning Joint Spatial-Temporal Transformations for Video Inpaintingcited by 163
- 2015Compression Artifacts Reduction by a Deep Convolutional Networkcited by 136
- 2019Deep Flow-Guided Video Inpaintingcited by 116
- 2022Towards An End-to-End Framework for Flow-Guided Video Inpaintingcited by 113
- 2019Deep Video Inpaintingcited by 109
- 2021FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpaintingcited by 95
- 2020Supervised Raw Video Denoising with a Benchmark Dataset on Dynamic Scenescited by 77
- 2024Transcending the Limit of Local Window: Advanced Super-Resolution Transformer with Adaptive Token Dictionarycited by 64
- 2021Efficient Multi-Stage Video Denoising with Recurrent Spatio-Temporal Fusioncited by 36
- 2022Error Compensation Framework for Flow-Guided Video Inpaintingcited by 20
- 2022On the Generalization of BasicVSR++ to Video Deblurring and Denoisingcited by 19
- 2023Bitstream-Corrupted Video Recovery: A Novel Benchmark Dataset and Methodcited by 15
- 2023Exploiting Optical Flow Guidance for Transformer-Based Video Inpaintingcited by 6
- 2025ANNEXE: Unified Analyzing, Answering, and Pixel Grounding for Egocentric Interactioncited by 5
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026NTIRE 2026 Challenge on Bitstream-Corrupted Video Restoration: Methods and Resultscited by 16
- 2026Accelerating Diffusion-based Video Editing via Heterogeneous Caching: Beyond Full Computing at Sampled Denoising Timestepcited by 3
- 2026Towards Bitstream-corrupted Harsh Visual Understanding: Through Bitstream Language Modeling as Robust Semantic Priorscited by 0
- 2026Reference-Efficient Multimodal Bitstream-Corrupted Video Recovery via Depth-Conditioned Adaptationcited by 0
- 2026Reference-Efficient Multimodal Bitstream-Corrupted Video Recovery via Depth-Conditioned Adaptation11 Oct 2026
- 2026Towards Bitstream-corrupted Harsh Visual Understanding: Through Bitstream Language Modeling as Robust Semantic Priors22 Aug 2026
- 2026NTIRE 2026 Challenge on Bitstream-Corrupted Video Restoration: Methods and Results8 Apr 2026
- 2026Accelerating Diffusion-based Video Editing via Heterogeneous Caching: Beyond Full Computing at Sampled Denoising Timestep25 Mar 2026