Reference-Efficient Multimodal Bitstream-Corrupted Video Recovery via Depth-Conditioned Adaptation
Not on the map. Why?
Abstract (arXiv)
Recovering visually faithful content from damaged video bitstreams is important for reliable multimedia communication and storage. Existing methods exploit local residuals and non-local RGB references of the input video sequence, but both sources can become unreliable after decoding, while processing additional references increases receiver computation and memory. This paper studies multimodal bitstream-corrupted video recovery (MBSCVR) using RGB and depth information, where pre-transmission depth-based geometry aids reconstruction when the received appearance is corrupted. We propose a novel MBSCVR framework that selects and effectively utilizes a single selected non-local RGB reference per recovery window to achieve higher performance. It integrates a reliability-aware multimodal selector that combines valid appearance with depth compatibility before reference encoding. Depth-Conditioned Reference Adaptation (DCRA) introduces selected RGB evidence into feature completion and content generation, while frame-aligned depth conditions completion queries. On the complete BSCV benchmark with oracle masks, MBSCVR uses one selected reference to achieve 32.30 dB on YouTube-VOS and 28.93 dB on DAVIS, surpassing full-reference B2SCVR by 0.27 and 0.33 dB and improving SSIM on both subsets. Matched receiver-forward measurements show 36.8% lower latency and 40.8% lower peak memory. These results demonstrate how compact geometric guidance and adapted appearance processing improve the quality--resource trade-off of multimedia recovery.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 31 references that are in the map. First posted on arXiv 11 Oct 2026.
Builds on
14 of 31 references.
References · 14
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2024Depth Anything V2cited by 1,422
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
- 2020Learning Joint Spatial-Temporal Transformations for Video Inpaintingcited by 163
- 2022Towards An End-to-End Framework for Flow-Guided Video Inpaintingcited by 113
- 2019Deep Video Inpaintingcited by 109
- 2021FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpaintingcited by 95
- 2021Event-guided Deblurring of Unknown Exposure Time Videoscited by 26
- 2026NTIRE 2026 Challenge on Bitstream-Corrupted Video Restoration: Methods and Resultscited by 16
- 2023Bitstream-Corrupted Video Recovery: A Novel Benchmark Dataset and Methodcited by 15
- 2024HINT: High-quality INPainting Transformer with Mask-Aware Encoding and Enhanced Attentioncited by 11
- 2025Towards Blind Bitstream-corrupted Video Recovery via a Visual Foundation Model-driven Frameworkcited by 4
Built on by
Not cited yet.