# Super-resolution image display using diffractive decoders

arXiv: https://arxiv.org/abs/2206.07281 · HTML: https://mlsanity.com/paper/2206.07281/

## Key facts

- Cited by 13 papers in the map (data through 14 Oct 2026).
- Builds on 12 of its 70 references that are in the map.
- First posted on arXiv 15 Jun 2022.

## Builds on (most cited first, 12 of 12)

- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [A Neural Representation of Sketch Drawings](https://mlsanity.com/paper/1704.03477/) (2017)
- [EMNIST: an extension of MNIST to handwritten letters](https://mlsanity.com/paper/1702.05373/) (2017)
- [All-Optical Machine Learning Using Diffractive Deep Neural Networks](https://mlsanity.com/paper/1804.08711/) (2018)
- [Deep neural networks for the evaluation and design of photonic devices](https://mlsanity.com/paper/2007.00084/) (2020)
- [Abandoning the Bayer-Filter to See in the Dark](https://mlsanity.com/paper/2203.04042/) (2022)
- [Misalignment Resilient Diffractive Optical Networks](https://mlsanity.com/paper/2005.11464/) (2020)
- [Analysis of Diffractive Optical Neural Networks and Their Integration with Electronic Neural Networks](https://mlsanity.com/paper/1810.01916/) (2018)
- [All-Optical Synthesis of an Arbitrary Linear Transformation Using Diffractive Surfaces](https://mlsanity.com/paper/2108.09833/) (2021)
- [Meta-optic Accelerators for Object Classifiers](https://mlsanity.com/paper/2201.11034/) (2022)
- [Polarization Multiplexed Diffractive Computing: All-Optical Implementation of a Group of Linear Transformations Through a Polarization-Encoded Diffractive Network](https://mlsanity.com/paper/2203.13482/) (2022)
- [All-Optical Information Processing Capacity of Diffractive Surfaces](https://mlsanity.com/paper/2007.12813/) (2020)

## Built on by (most cited first, 13 of 13)

- [SVQA-R1: Reinforcing Spatial Reasoning in MLLMs via View-Consistent Reward Optimization](https://mlsanity.com/paper/2506.01371/) (2025)
- [Optical Generative Models](https://mlsanity.com/paper/2410.17970/) (2024)
- [Diffractive Interconnects: All-Optical Permutation Operation Using Diffractive Networks](https://mlsanity.com/paper/2206.10152/) (2022)
- [All-optical image denoising using a diffractive visual processor](https://mlsanity.com/paper/2309.09215/) (2023)
- [Time-lapse image classification using a diffractive neural network](https://mlsanity.com/paper/2208.10802/) (2022)
- [Optical Diffusion Models for Image Generation](https://mlsanity.com/paper/2407.10897/) (2024)
- [All-optical complex field imaging using diffractive processors](https://mlsanity.com/paper/2401.16779/) (2024)
- [Multiplexed all-optical permutation operations using a reconfigurable diffractive optical network](https://mlsanity.com/paper/2402.02397/) (2024)
- [Integration of Programmable Diffraction with Digital Neural Networks](https://mlsanity.com/paper/2406.10688/) (2024)
- [BlurryScope enables compact, cost-effective scanning microscopy for HER2 scoring using deep learning on blurry images](https://mlsanity.com/paper/2410.17557/) (2024)
- [Super-resolution image projection over an extended depth of field using a diffractive decoder](https://mlsanity.com/paper/2510.03938/) (2025)
- [Snapshot 3D image projection using a diffractive decoder](https://mlsanity.com/paper/2512.20464/) (2025)
- [Automated HER2 scoring with uncertainty quantification using lensfree holography and deep learning](https://mlsanity.com/paper/2601.18219/) (2026)

## Abstract (arXiv)

High-resolution synthesis/projection of images over a large field-of-view (FOV) is hindered by the restricted space-bandwidth-product (SBP) of wavefront modulators. We report a deep learning-enabled diffractive display design that is based on a jointly-trained pair of an electronic encoder and a diffractive optical decoder to synthesize/project super-resolved images using low-resolution wavefront modulators. The digital encoder, composed of a trained convolutional neural network (CNN), rapidly pre-processes the high-resolution images of interest so that their spatial information is encoded into low-resolution (LR) modulation patterns, projected via a low SBP wavefront modulator. The diffractive decoder processes this LR encoded information using thin transmissive layers that are structured using deep learning to all-optically synthesize and project super-resolved images at its output FOV. Our results indicate that this diffractive image display can achieve a super-resolution factor of ~4, demonstrating a ~16-fold increase in SBP. We also experimentally validate the success of this diffractive super-resolution display using 3D-printed diffractive decoders that operate at the THz spectrum. This diffractive image decoder can be scaled to operate at visible wavelengths and inspire the design of large FOV and high-resolution displays that are compact, low-power, and computationally efficient.
