# Light Field Spatial Super-resolution via Deep Combinatorial Geometry Embedding and Structural Consistency Regularization

arXiv: https://arxiv.org/abs/2004.02215 · HTML: https://mlsanity.com/paper/2004.02215/

## Key facts

- Cited by 36 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 5 Apr 2020.

## Built on by (most cited first, 30 of 36)

- [Disentangling Light Fields for Super-Resolution and Disparity Estimation](https://mlsanity.com/paper/2202.10603/) (2022)
- [Light Field Image Super-Resolution with Transformers](https://mlsanity.com/paper/2108.07597/) (2021)
- [Detail-Preserving Transformer for Light Field Image Super-Resolution](https://mlsanity.com/paper/2201.00346/) (2022)
- [Bridging Unsupervised and Supervised Depth from Focus via All-in-Focus Supervision](https://mlsanity.com/paper/2108.10843/) (2021)
- [Learning Non-Local Spatial-Angular Correlation for Light Field Image Super-Resolution](https://mlsanity.com/paper/2302.08058/) (2023)
- [Learning Sub-Pixel Disparity Distribution for Light Field Depth Estimation](https://mlsanity.com/paper/2208.09688/) (2022)
- [LRT: An Efficient Low-Light Restoration Transformer for Dark Light Field Images](https://mlsanity.com/paper/2209.02197/) (2022)
- [Incorporating Degradation Estimation in Light Field Spatial Super-Resolution](https://mlsanity.com/paper/2405.07012/) (2024)
- [Real-World Light Field Image Super-Resolution via Degradation Modulation](https://mlsanity.com/paper/2206.06214/) (2022)
- [Dense Dual-Attention Network for Light Field Image Super-Resolution](https://mlsanity.com/paper/2110.12114/) (2021)
- [NTIRE 2023 Challenge on Light Field Image Super-Resolution: Dataset, Methods and Results](https://mlsanity.com/paper/2304.10415/) (2023)
- [LFMamba: Light Field Image Super-Resolution with State Space Model](https://mlsanity.com/paper/2406.12463/) (2024)
- [Probabilistic-based Feature Embedding of 4-D Light Fields for Compressive Imaging and Denoising](https://mlsanity.com/paper/2306.08836/) (2023)
- [LFSRDiff: Light Field Image Super-Resolution via Diffusion Models](https://mlsanity.com/paper/2311.16517/) (2023)
- [Light Field Reconstruction via Deep Adaptive Fusion of Hybrid Lenses](https://mlsanity.com/paper/2102.07085/) (2021)
- [Learning Dynamic Interpolation for Extremely Sparse Light Fields with Wide Baselines](https://mlsanity.com/paper/2108.07408/) (2021)
- [Texture-enhanced Light Field Super-resolution with Spatio-Angular Decomposition Kernels](https://mlsanity.com/paper/2111.04069/) (2021)
- [Light Field Implicit Representation for Flexible Resolution Reconstruction](https://mlsanity.com/paper/2112.00185/) (2021)
- [OccCasNet: Occlusion-aware Cascade Cost Volume for Light Field Depth Estimation](https://mlsanity.com/paper/2305.17710/) (2023)
- [Toward Real-World Light Field Super-Resolution](https://mlsanity.com/paper/2305.18994/) (2023)
- [Beyond Subspace Isolation: Many-to-Many Transformer for Light Field Image Super-resolution](https://mlsanity.com/paper/2401.00740/) (2024)
- [Scale-Consistent Fusion: from Heterogeneous Local Sampling to Global Immersive Rendering](https://mlsanity.com/paper/2106.09548/) (2021)
- [LGFN: Lightweight Light Field Image Super-Resolution using Local Convolution Modulation and Global Attention Feature Extraction](https://mlsanity.com/paper/2409.17759/) (2024)
- [L2FMamba: Lightweight Light Field Image Super-Resolution with State Space Model](https://mlsanity.com/paper/2503.19253/) (2025)
- [OAFuser: Towards Omni-Aperture Fusion for Light Field Semantic Segmentation](https://mlsanity.com/paper/2307.15588/) (2023)
- [MaskBlur: Spatial and Angular Data Augmentation for Light Field Image Super-Resolution](https://mlsanity.com/paper/2410.06478/) (2024)
- [Deep Learning Empowered Super-Resolution: A Comprehensive Survey and Future Prospects](https://mlsanity.com/paper/2509.22692/) (2025)
- [Light field Rectification based on relative pose estimation](https://mlsanity.com/paper/2201.12533/) (2022)
- [View Adaptive Light Field Deblurring Networks with Depth Perception](https://mlsanity.com/paper/2303.06860/) (2023)
- [Physics-Informed Ensemble Representation for Light-Field Image Super-Resolution](https://mlsanity.com/paper/2305.20006/) (2023)

## Abstract (arXiv)

Light field (LF) images acquired by hand-held devices usually suffer from low spatial resolution as the limited sampling resources have to be shared with the angular dimension. LF spatial super-resolution (SR) thus becomes an indispensable part of the LF camera processing pipeline. The high-dimensionality characteristic and complex geometrical structure of LF images make the problem more challenging than traditional single-image SR. The performance of existing methods is still limited as they fail to thoroughly explore the coherence among LF views and are insufficient in accurately preserving the parallax structure of the scene. In this paper, we propose a novel learning-based LF spatial SR framework, in which each view of an LF image is first individually super-resolved by exploring the complementary information among views with combinatorial geometry embedding. For accurate preservation of the parallax structure among the reconstructed views, a regularization network trained over a structure-aware loss function is subsequently appended to enforce correct parallax relationships over the intermediate estimation. Our proposed approach is evaluated over datasets with a large number of testing images including both synthetic and real-world scenes. Experimental results demonstrate the advantage of our approach over state-of-the-art methods, i.e., our method not only improves the average PSNR by more than 1.0 dB but also preserves more accurate parallax details, at a lower computational cost.
