# Cascaded Local Implicit Transformer for Arbitrary-Scale Super-Resolution

arXiv: https://arxiv.org/abs/2303.16513 · HTML: https://mlsanity.com/paper/2303.16513/

## Key facts

- Cited by 52 papers in the map (data through 14 Oct 2026).
- Builds on 43 of its 54 references that are in the map.
- First posted on arXiv 29 Mar 2023.

## Builds on (most cited first, 30 of 43)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [Swin Transformer: Hierarchical Vision Transformer using Shifted Windows](https://mlsanity.com/paper/2103.14030/) (2021)
- [DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation](https://mlsanity.com/paper/1901.05103/) (2019)
- [Implicit Neural Representations with Periodic Activation Functions](https://mlsanity.com/paper/2006.09661/) (2020)
- [Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains](https://mlsanity.com/paper/2006.10739/) (2020)
- [Occupancy Networks: Learning 3D Reconstruction in Function Space](https://mlsanity.com/paper/1812.03828/) (2018)
- [Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields](https://mlsanity.com/paper/2103.13415/) (2021)
- [Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network](https://mlsanity.com/paper/1609.04802/) (2016)
- [SwinIR: Image Restoration Using Swin Transformer](https://mlsanity.com/paper/2108.10257/) (2021)
- [Enhanced Deep Residual Networks for Single Image Super-Resolution](https://mlsanity.com/paper/1707.02921/) (2017)
- [On the Spectral Bias of Neural Networks](https://mlsanity.com/paper/1806.08734/) (2018)
- [Image Super-Resolution Using Very Deep Residual Channel Attention Networks](https://mlsanity.com/paper/1807.02758/) (2018)
- [ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks](https://mlsanity.com/paper/1809.00219/) (2018)
- [Image Super-Resolution Using Deep Convolutional Networks](https://mlsanity.com/paper/1501.00092/) (2014)
- [Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network](https://mlsanity.com/paper/1609.05158/) (2016)
- [Learning Implicit Fields for Generative Shape Modeling](https://mlsanity.com/paper/1812.02822/) (2018)
- [Neural Sparse Voxel Fields](https://mlsanity.com/paper/2007.11571/) (2020)
- [Accurate Image Super-Resolution Using Very Deep Convolutional Networks](https://mlsanity.com/paper/1511.04587/) (2015)
- [Pre-Trained Image Processing Transformer](https://mlsanity.com/paper/2012.00364/) (2020)
- [Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representations](https://mlsanity.com/paper/1906.01618/) (2019)
- [Residual Dense Network for Image Super-Resolution](https://mlsanity.com/paper/1802.08797/) (2018)
- [Convolutional Occupancy Networks](https://mlsanity.com/paper/2003.04618/) (2020)
- [Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervision](https://mlsanity.com/paper/1912.07372/) (2019)
- [Learning Continuous Image Representation with Local Implicit Image Function](https://mlsanity.com/paper/2012.09161/) (2020)
- [Activating More Pixels in Image Super-Resolution Transformer](https://mlsanity.com/paper/2205.04437/) (2022)
- [Accelerating the Super-Resolution Convolutional Neural Network](https://mlsanity.com/paper/1608.00367/) (2016)
- [SAL: Sign Agnostic Learning of Shapes from Raw Data](https://mlsanity.com/paper/1911.10414/) (2019)
- [Local Implicit Grid Representations for 3D Scenes](https://mlsanity.com/paper/2003.08981/) (2020)
- [FNet: Mixing Tokens with Fourier Transforms](https://mlsanity.com/paper/2105.03824/) (2021)

## Built on by (most cited first, 30 of 52)

- [Bidirectional Multi-Scale Implicit Neural Representations for Image Deraining](https://mlsanity.com/paper/2404.01547/) (2024)
- [Pixel to Gaussian: Ultra-Fast Continuous Super-Resolution with 2D Gaussian Modeling](https://mlsanity.com/paper/2503.06617/) (2025)
- [Learning A Physical-aware Diffusion Model Based on Transformer for Underwater Image Enhancement](https://mlsanity.com/paper/2403.01497/) (2024)
- [Latent Modulated Function for Computational Optimal Continuous Image Representation](https://mlsanity.com/paper/2404.16451/) (2024)
- [Generalized and Efficient 2D Gaussian Splatting for Arbitrary-scale Super-Resolution](https://mlsanity.com/paper/2501.06838/) (2025)
- [HIIF: Hierarchical Encoding based Implicit Image Function for Continuous Super-resolution](https://mlsanity.com/paper/2412.03748/) (2024)
- [CycleINR: Cycle Implicit Neural Representation for Arbitrary-Scale Volumetric Super-Resolution of Medical Data](https://mlsanity.com/paper/2404.04878/) (2024)
- [DiffFNO: Diffusion Fourier Neural Operator](https://mlsanity.com/paper/2411.09911/) (2024)
- [S3Mamba: Arbitrary-Scale Super-Resolution via Scaleable State Space Model](https://mlsanity.com/paper/2411.11906/) (2024)
- [Fourier-enhanced Implicit Neural Fusion Network for Multispectral and Hyperspectral Image Fusion](https://mlsanity.com/paper/2404.15174/) (2024)
- [Arbitrary-Scale Video Super-Resolution with Structural and Textural Priors](https://mlsanity.com/paper/2407.09919/) (2024)
- [HoliSDiP: Image Super-Resolution via Holistic Semantics and Diffusion Prior](https://mlsanity.com/paper/2411.18662/) (2024)
- [Boosting Flow-based Generative Super-Resolution Models via Learned Prior](https://mlsanity.com/paper/2403.10988/) (2024)
- [Thera: Aliasing-Free Arbitrary-Scale Super-Resolution with Neural Heat Fields](https://mlsanity.com/paper/2311.17643/) (2023)
- [HR-INR: Continuous Space-Time Video Super-Resolution via Event Camera](https://mlsanity.com/paper/2405.13389/) (2024)
- [SSL: A Self-similarity Loss for Improving Generative Image Super-resolution](https://mlsanity.com/paper/2408.05713/) (2024)
- [Rotation Equivariant Arbitrary-scale Image Super-Resolution](https://mlsanity.com/paper/2508.05160/) (2025)
- [Blind Video Super-Resolution based on Implicit Kernels](https://mlsanity.com/paper/2503.07856/) (2025)
- [INRetouch: Context Aware Implicit Neural Representation for Photography Retouching](https://mlsanity.com/paper/2412.03848/) (2024)
- [Scale-Invariant Adversarial Attack against Arbitrary-scale Super-resolution](https://mlsanity.com/paper/2503.04385/) (2025)
- [StereoINR: Cross-View Geometry Consistent Stereo Super Resolution with Implicit Neural Representation](https://mlsanity.com/paper/2505.05509/) (2025)
- [Continuous Space-Time Video Super-Resolution with 3D Fourier Fields](https://mlsanity.com/paper/2509.26325/) (2025)
- [SR-CACO-2: A Dataset for Confocal Fluorescence Microscopy Image Super-Resolution](https://mlsanity.com/paper/2406.09168/) (2024)
- [Test-time Cost-and-Quality Controllable Arbitrary-Scale Super-Resolution with Variable Fourier Components](https://mlsanity.com/paper/2412.05517/) (2024)
- [An efficient dual-branch framework via implicit self-texture enhancement for arbitrary-scale histopathology image super-resolution](https://mlsanity.com/paper/2401.15613/) (2024)
- [Adaptive Multi-modal Fusion of Spatially Variant Kernel Refinement with Diffusion Model for Blind Image Super-Resolution](https://mlsanity.com/paper/2403.05808/) (2024)
- [LeRF: Learning Resampling Function for Adaptive and Efficient Image Interpolation](https://mlsanity.com/paper/2407.09935/) (2024)
- [Multiscale Corrections by Continuous Super-Resolution](https://mlsanity.com/paper/2411.07576/) (2024)
- [Self-Cascaded Diffusion Models for Arbitrary-Scale Image Super-Resolution](https://mlsanity.com/paper/2506.07813/) (2025)
- [Deep Learning Empowered Super-Resolution: A Comprehensive Survey and Future Prospects](https://mlsanity.com/paper/2509.22692/) (2025)

## Abstract (arXiv)

Implicit neural representation has recently shown a promising ability in representing images with arbitrary resolutions. In this paper, we present a Local Implicit Transformer (LIT), which integrates the attention mechanism and frequency encoding technique into a local implicit image function. We design a cross-scale local attention block to effectively aggregate local features. To further improve representative power, we propose a Cascaded LIT (CLIT) that exploits multi-scale features, along with a cumulative training strategy that gradually increases the upsampling scales during training. We have conducted extensive experiments to validate the effectiveness of these components and analyze various training strategies. The qualitative and quantitative results demonstrate that LIT and CLIT achieve favorable results and outperform the prior works in arbitrary super-resolution tasks.