# LGFN: Lightweight Light Field Image Super-Resolution using Local Convolution Modulation and Global Attention Feature Extraction

arXiv: https://arxiv.org/abs/2409.17759 · HTML: https://mlsanity.com/paper/2409.17759/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 25 of its 50 references that are in the map.
- First posted on arXiv 26 Sep 2024.

## Builds on (most cited first, 25 of 25)

- [Enhanced Deep Residual Networks for Single Image Super-Resolution](https://mlsanity.com/paper/1707.02921/) (2017)
- [Image Super-Resolution Using Very Deep Residual Channel Attention Networks](https://mlsanity.com/paper/1807.02758/) (2018)
- [Accurate Image Super-Resolution Using Very Deep Convolutional Networks](https://mlsanity.com/paper/1511.04587/) (2015)
- [Light Field Networks: Neural Scene Representations with Single-Evaluation Rendering](https://mlsanity.com/paper/2106.02634/) (2021)
- [Visual Attention Network](https://mlsanity.com/paper/2202.09741/) (2022)
- [Focal Modulation Networks](https://mlsanity.com/paper/2203.11926/) (2022)
- [R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesis](https://mlsanity.com/paper/2203.17261/) (2022)
- [Learning Neural Light Fields with Ray-Space Embedding Networks](https://mlsanity.com/paper/2112.01523/) (2021)
- [EPINET: A Fully-Convolutional Neural Network Using Epipolar Geometry for Depth from Light Field Images](https://mlsanity.com/paper/1804.02379/) (2018)
- [Disentangling Light Fields for Super-Resolution and Disparity Estimation](https://mlsanity.com/paper/2202.10603/) (2022)
- [Spatial-Angular Interaction for Light Field Image Super-Resolution](https://mlsanity.com/paper/1912.07849/) (2019)
- [Light Field Spatial Super-resolution via Deep Combinatorial Geometry Embedding and Structural Consistency Regularization](https://mlsanity.com/paper/2004.02215/) (2020)
- [Light Field Image Super-Resolution with Transformers](https://mlsanity.com/paper/2108.07597/) (2021)
- [Light Field Image Super-Resolution Using Deformable Convolution](https://mlsanity.com/paper/2007.03535/) (2020)
- [Detail-Preserving Transformer for Light Field Image Super-Resolution](https://mlsanity.com/paper/2201.00346/) (2022)
- [A System for Acquiring, Processing, and Rendering Panoramic Light Field Stills for Virtual Reality](https://mlsanity.com/paper/1810.08860/) (2018)
- [Occlusion-Aware Cost Constructor for Light Field Depth Estimation](https://mlsanity.com/paper/2203.01576/) (2022)
- [High-dimensional Dense Residual Convolutional Neural Network for Light Field Reconstruction](https://mlsanity.com/paper/1910.01426/) (2019)
- [Learning Non-Local Spatial-Angular Correlation for Light Field Image Super-Resolution](https://mlsanity.com/paper/2302.08058/) (2023)
- [Selective Light Field Refocusing for Camera Arrays Using Bokeh Rendering and Superresolution](https://mlsanity.com/paper/2108.03918/) (2021)
- [Efficient Modulation for Vision Networks](https://mlsanity.com/paper/2403.19963/) (2024)
- [Revisiting Light Field Rendering with Deep Anti-Aliasing Neural Network](https://mlsanity.com/paper/2104.06797/) (2021)
- [Learning Sub-Pixel Disparity Distribution for Light Field Depth Estimation](https://mlsanity.com/paper/2208.09688/) (2022)
- [Real-World Light Field Image Super-Resolution via Degradation Modulation](https://mlsanity.com/paper/2206.06214/) (2022)
- [Toward Real-World Light Field Super-Resolution](https://mlsanity.com/paper/2305.18994/) (2023)

## Built on by (most cited first, 2 of 2)

- [MRC-DETR: An Adaptive Multi-Residual Coupled Transformer for Bare Board PCB Defect Detection](https://mlsanity.com/paper/2507.03386/) (2025)
- [VSANet: View-aware Sparse Attention Network for Light Field Image Denoising](https://mlsanity.com/paper/2606.24737/) (2026)

## Abstract (arXiv)

Capturing different intensity and directions of light rays at the same scene Light field (LF) can encode the 3D scene cues into a 4D LF image which has a wide range of applications (i.e. post-capture refocusing and depth sensing). LF image super-resolution (SR) aims to improve the image resolution limited by the performance of LF camera sensor. Although existing methods have achieved promising results the practical application of these models is limited because they are not lightweight enough. In this paper we propose a lightweight model named LGFN which integrates the local and global features of different views and the features of different channels for LF image SR. Specifically owing to neighboring regions of the same pixel position in different sub-aperture images exhibit similar structural relationships we design a lightweight CNN-based feature extraction module (namely DGCE) to extract local features better through feature modulation. Meanwhile as the position beyond the boundaries in the LF image presents a large disparity we propose an efficient spatial attention module (namely ESAM) which uses decomposable large-kernel convolution to obtain an enlarged receptive field and an efficient channel attention module (namely ECAM). Compared with the existing LF image SR models with large parameter our model has a parameter of 0.45M and a FLOPs of 19.33G which has achieved a competitive effect. Extensive experiments with ablation studies demonstrate the effectiveness of our proposed method which ranked the second place in the Track 2 Fidelity & Efficiency of NTIRE2024 Light Field Super Resolution Challenge and the seventh place in the Track 1 Fidelity.
