mlsanityData to 7 Oct 2026

GTF: Omnidirectional EPI Transformer for Light Field Super-Resolution

arXiv 2605.04581 ↗First posted 6 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Light field (LF) image super-resolution benefits from Epipolar Plane Images (EPIs), whose line slopes explicitly encode disparity. However, existing Transformer-based LF SR methods mainly attend to horizontal and vertical EPIs, leaving diagonal epipolar geometry underexplored. We present GTF, an omnidirectional EPI Transformer that explicitly models horizontal, vertical, 45-degree, and 135-degree EPIs within a unified reconstruction framework. GTF combines directional EPI processing, MacPI-based prior injection, adaptive directional fusion, and a topology-preserving feed-forward network to better exploit LF geometry. For the NTIRE 2026 fidelity tracks, we use GTF as the main model, while a lightweight GTF-Tiny variant targets the efficiency track. On five standard LF SR benchmarks covering both real-captured and synthetic scenes, GTF reaches 32.78 dB without inference-time enhancement, and stronger inference settings with EPSW and test-time augmentation further improve performance. Under the NTIRE 2026 efficiency constraint, GTF-Tiny attains 32.57 dB with only 0.915M parameters and 19.81 GFLOPs. In the NTIRE 2026 Light Field Image Super-Resolution Challenge, our submissions rank 3rd on Track 1 and Track 3 and 4th on Track 2. Architecture-evolution, channel-width, and inference analyses further support the effectiveness of diagonal EPI modeling, directional fusion, and the lightweight design.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 33 references that are in the map. First posted on arXiv 6 May 2026.

Builds on

20 of 33 references.

References · 20

  1. 2017Attention Is All You Needcited by 59,932
  2. 2016Layer Normalizationcited by 5,579
  3. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  4. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
  5. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  6. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  7. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
  8. 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
  9. 2024VMamba: Visual State Space Modelcited by 955
  10. 2016Training Region-based Object Detectors with Online Hard Example Miningcited by 577
  11. 2016Learning-Based View Synthesis for Light Field Camerascited by 145
  12. 2018EPINET: A Fully-Convolutional Neural Network Using Epipolar Geometry for Depth from Light Field Imagescited by 46
8 more
  1. 2022Disentangling Light Fields for Super-Resolution and Disparity Estimationcited by 42
  2. 2019Spatial-Angular Interaction for Light Field Image Super-Resolutioncited by 38
  3. 2020Light Field Spatial Super-resolution via Deep Combinatorial Geometry Embedding and Structural Consistency Regularizationcited by 36
  4. 2021Light Field Image Super-Resolution with Transformerscited by 31
  5. 2020Light Field Image Super-Resolution Using Deformable Convolutioncited by 30
  6. 2022Detail-Preserving Transformer for Light Field Image Super-Resolutioncited by 26
  7. 2023Learning Non-Local Spatial-Angular Correlation for Light Field Image Super-Resolutioncited by 21
  8. 2023NTIRE 2023 Challenge on Light Field Image Super-Resolution: Dataset, Methods and Resultscited by 7

Built on by

Not cited yet.