PolarVSR: A Unified Framework and Benchmark for Continuous Space-Time Polarization Video Reconstruction
Not on the map. Why?
Abstract (arXiv)
Polarimetric imaging captures surface polarization characteristics, such as the Degree of Linear Polarization (DoLP) and the Angle of Polarization (AoP). In mainstream Division of-Focal-Plane (DoFP) color polarization imaging, recovering polarization parameters from captured mosaic arrays remains a challenging inverse problem. Existing DoFP cameras also face hardware bottlenecks and often cannot support high-frame-rate acquisition, limiting polarimetric imaging in dynamic video tasks. These limitations motivate joint spatial and temporal enhancement. To this end, we propose the first space-time polarization video reconstruction architecture. The method jointly models polarization directions in space and time and uses a polarization-aware implicit neural representation for continuous, high-fidelity upsampling. By analyzing temporal variations in polarization parameters, we further introduce a flow-guided polarization variation loss to supervise polarization dynamics. We also establish the first large-scale color DoFP polarization video benchmark to support this research direction. Extensive experiments on this benchmark demonstrate the effectiveness of the method.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 45 of its 69 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
45 of 69 references.
References · 45
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2021Image Super-Resolution via Iterative Refinementcited by 1,511
- 2015Spatial Transformer Networkscited by 1,429
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
- 2018Deformable ConvNets v2: More Deformable, Better Resultscited by 670
- 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Modelcited by 583
- 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 552
- 2018Recovering Realistic Texture in Image Super-resolution by Deep Spatial Feature Transformcited by 371
- 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 342
- 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 326
- 2020Softmax Splatting for Video Frame Interpolationcited by 279
33 more
- 2018Learning Blind Video Temporal Consistencycited by 253
- 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 174
- 2019Quadratic video interpolationcited by 145
- 2021Video Frame Interpolation Transformercited by 123
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 102
- 2022VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolutioncited by 101
- 2020Zooming Slow-Mo: Fast and Accurate One-Stage Space-Time Video Super-Resolutioncited by 91
- 2025MotionBench: Benchmarking and Improving Fine-grained Video Motion Understanding for Vision Language Modelscited by 70
- 2020Polarized Reflection Removal with Perfect Alignment in the Wildcited by 69
- 2024VEnhancer: Generative Space-Time Enhancement for Video Generationcited by 64
- 2021Deep Polarization Imaging for 3D shape and SVBRDF Acquisitioncited by 56
- 2021Temporal Modulation Network for Controllable Space-Time Video Super-Resolutioncited by 54
- 2021Shape from Polarization for Complex Scenes in the Wildcited by 53
- 2020Space-Time-Aware Multi-Resolution Video Enhancementcited by 49
- 2024Blind Image Restoration via Fast Diffusion Inversioncited by 30
- 2025PolarFree: Polarization-based Reflection-free Imagingcited by 18
- 2023MoTIF: Learning Motion Trajectories with Local Implicit Neural Functions for Continuous Space-Time Video Super-Resolutioncited by 16
- 2020Monochrome and Color Polarization Demosaicking Using Edge-Aware Residual Interpolationcited by 15
- 2024Image Neural Field Diffusion Modelscited by 13
- 2024Invertible Diffusion Models for Compressed Sensingcited by 12
- 2025PIDSR: Complementary Polarized Image Demosaicing and Super-Resolutioncited by 11
- 20256D Object Pose Tracking in Internet Videos for Robotic Manipulationcited by 10
- 2022Two-Step Color-Polarization Demosaicking Networkcited by 9
- 2025BF-STVSR: B-Splines and Fourier-Best Friends for High Fidelity Spatial-Temporal Video Super-Resolutioncited by 9
- 2025Rethinking Temporal Fusion with a Unified Gradient Descent View for 3D Semantic Occupancy Predictioncited by 9
- 2023Spectral and Polarization Vision: Spectro-polarimetric Real-world Datasetcited by 8
- 2023ShareCMP: Polarization-Aware RGB-P Semantic Segmentationcited by 7
- 2025Polarization Denoising and Demosaicking: Dataset and Baseline Methodcited by 5
- 2026Polarization Uncertainty-Guided Diffusion Model for Color Polarization Image Demosaickingcited by 4
- 2025Benchmarking Burst Super-Resolution for Polarization Images: Noise Dataset and Analysiscited by 3
- 2025Continuous Space-Time Video Super-Resolution with 3D Fourier Fieldscited by 3
- 2026ATD: Improved Transformer with Adaptive Token Dictionary for Image Restorationcited by 3
- 2026Taming Real-World Space-Time Video Super-Resolution with One-Step Diffusioncited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.