# Metasurface-Enabled On-Chip Multiplexed Diffractive Neural Networks in the Visible

arXiv: https://arxiv.org/abs/2107.07873 · HTML: https://mlsanity.com/paper/2107.07873/

## Key facts

- Cited by 18 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 13 Jul 2021.

## Built on by (most cited first, 18 of 18)

- [Image sensing with multilayer, nonlinear optical neural networks](https://mlsanity.com/paper/2207.14293/) (2022)
- [Spatially Varying Nanophotonic Neural Networks](https://mlsanity.com/paper/2308.03407/) (2023)
- [Over-the-Air Edge Inference via End-to-End Metasurfaces-Integrated Artificial Neural Networks](https://mlsanity.com/paper/2504.00233/) (2025)
- [All-optical image classification through unknown random diffusers using a single-pixel diffractive network](https://mlsanity.com/paper/2208.03968/) (2022)
- [Time-lapse image classification using a diffractive neural network](https://mlsanity.com/paper/2208.10802/) (2022)
- [Physics-constrained 3D Convolutional Neural Networks for Electrodynamics](https://mlsanity.com/paper/2301.13715/) (2023)
- [Pyramid diffractive optical networks for unidirectional image magnification and demagnification](https://mlsanity.com/paper/2308.15019/) (2023)
- [RF-Photonic Deep Learning Processor with Shannon-Limited Data Movement](https://mlsanity.com/paper/2207.06883/) (2022)
- [RIS-Based On-the-Air Semantic Communications -- a Diffractional Deep Neural Network Approach](https://mlsanity.com/paper/2312.00535/) (2023)
- [SP2RINT: Spatially-Decoupled Physics-Inspired Progressive Inverse Optimization for Scalable, PDE-Constrained Meta-Optical Neural Network Training](https://mlsanity.com/paper/2505.18377/) (2025)
- [Decision-making and control with diffractive optical networks](https://mlsanity.com/paper/2212.11278/) (2022)
- [Scientific Computing with Diffractive Optical Neural Networks](https://mlsanity.com/paper/2302.10905/) (2023)
- [Deep Learning-Assisted Simultaneous Targets Sensing and Super-Resolution Imaging](https://mlsanity.com/paper/2305.03177/) (2023)
- [Intelligent Multi-channel Meta-imagers for Accelerating Machine Vision](https://mlsanity.com/paper/2306.07365/) (2023)
- [Metasurface-generated large and arbitrary analog convolution kernels for accelerated machine vision](https://mlsanity.com/paper/2409.18614/) (2024)
- [Programmable metasurfaces for future photonic artificial intelligence](https://mlsanity.com/paper/2505.11659/) (2025)
- [All-Optical Segmentation via Diffractive Neural Networks for Autonomous Driving](https://mlsanity.com/paper/2602.07717/) (2026)
- [ReDON: Recurrent Diffractive Optical Neural Processor with Reconfigurable Self-Modulated Nonlinearity](https://mlsanity.com/paper/2602.23616/) (2026)

## Abstract (arXiv)

Replacing electrons with photons is a compelling route towards light-speed, highly parallel, and low-power artificial intelligence computing. Recently, all-optical diffractive neural deep neural networks have been demonstrated. However, the existing architectures often comprise bulky components and, most critically, they cannot mimic the human brain for multitasking. Here, we demonstrate a multi-skilled diffractive neural network based on a metasurface device, which can perform on-chip multi-channel sensing and multitasking at the speed of light in the visible. The metasurface is integrated with a complementary metal oxide semiconductor imaging sensor. Polarization multiplexing scheme of the subwavelength nanostructures are applied to construct a multi-channel classifier framework for simultaneous recognition of digital and fashionable items. The areal density of the artificial neurons can reach up to 6.25x106/mm2 multiplied by the number of channels. Our platform provides an integrated solution with all-optical on-chip sensing and computing for applications in machine vision, autonomous driving, and precision medicine.