To image, or not to image: Class-specific diffractive cameras with all-optical erasure of undesired objects
Not on the map. Why?
Abstract (arXiv)
Privacy protection is a growing concern in the digital era, with machine vision techniques widely used throughout public and private settings. Existing methods address this growing problem by, e.g., encrypting camera images or obscuring/blurring the imaged information through digital algorithms. Here, we demonstrate a camera design that performs class-specific imaging of target objects with instantaneous all-optical erasure of other classes of objects. This diffractive camera consists of transmissive surfaces structured using deep learning to perform selective imaging of target classes of objects positioned at its input field-of-view. After their fabrication, the thin diffractive layers collectively perform optical mode filtering to accurately form images of the objects that belong to a target data class or group of classes, while instantaneously erasing objects of the other data classes at the output field-of-view. Using the same framework, we also demonstrate the design of class-specific permutation cameras, where the objects of a target data class are pixel-wise permuted for all-optical class-specific encryption, while the other objects are irreversibly erased from the output image. The success of class-specific diffractive cameras was experimentally demonstrated using terahertz (THz) waves and 3D-printed diffractive layers that selectively imaged only one class of the MNIST handwritten digit dataset, all-optically erasing the other handwritten digits. This diffractive camera design can be scaled to different parts of the electromagnetic spectrum, including, e.g., the visible and infrared wavelengths, to provide transformative opportunities for privacy-preserving digital cameras and task-specific data-efficient imaging.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Builds on 9 of its 50 references that are in the map. First posted on arXiv 26 May 2022.
Builds on
9 of 50 references.
References · 9
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
- 2017Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Artcited by 182
- 2018All-Optical Machine Learning Using Diffractive Deep Neural Networkscited by 177
- 2020Misalignment Resilient Diffractive Optical Networkscited by 33
- 2018Learning Privacy Preserving Encodings through Adversarial Trainingcited by 30
- 2019Design of Task-Specific Optical Systems Using Broadband Diffractive Neural Networkscited by 27
- 2021All-Optical Synthesis of an Arbitrary Linear Transformation Using Diffractive Surfacescited by 24
- 2019Privacy Protection in Street-View Panoramas using Depth and Multi-View Imagerycited by 18
Built on by
Citing papers per year: 2022: 5; 2023: 5; 2024: 8; 2025: 0; 2026: 3.
21 papers.
Sort:
- 2024Training of Physical Neural Networkscited by 49
- 2023On the use of deep learning for phase recoverycited by 20
- 2022Snapshot Multispectral Imaging Using a Diffractive Optical Networkcited by 16
- 2022Unidirectional Imaging using Deep Learning-Designed Materialscited by 13
- 2023All-Optical Phase Conjugation Using Diffractive Wavefront Processingcited by 8
- 2024Optical Generative Modelscited by 8
- 2022Diffractive Interconnects: All-Optical Permutation Operation Using Diffractive Networkscited by 6
- 2023All-optical image denoising using a diffractive visual processorcited by 6
- 2024Information hiding cameras: optical concealment of object information into ordinary imagescited by 6
- 2022All-optical image classification through unknown random diffusers using a single-pixel diffractive networkcited by 5
- 2022Time-lapse image classification using a diffractive neural networkcited by 4
- 2023Pyramid diffractive optical networks for unidirectional image magnification and demagnificationcited by 3
9 more
- 2024All-optical complex field imaging using diffractive processorscited by 2
- 2024Multiplexed all-optical permutation operations using a reconfigurable diffractive optical networkcited by 2
- 2024Multiplane Quantitative Phase Imaging Using a Wavelength-Multiplexed Diffractive Optical Processorcited by 2
- 2023The Need for Inherently Privacy-Preserving Vision in Trustworthy Autonomous Systemscited by 1
- 2024Integration of Programmable Diffraction with Digital Neural Networkscited by 1
- 2024Unidirectional imaging with partially coherent lightcited by 1
- 2026Illumination Angular Spectrum Encoding for Controlling the Functionality of Diffractive Networkscited by 0
- 2026Wavelength-multiplexed massively parallel diffractive optical information storage and image projectioncited by 0
- 2026Wavelength-Multiplexed 2D Beam Steering via a Passive Diffractive Networkcited by 0
- 2026Wavelength-Multiplexed 2D Beam Steering via a Passive Diffractive Network15 Jun 2026
- 2026Wavelength-multiplexed massively parallel diffractive optical information storage and image projection3 Apr 2026
- 2026Illumination Angular Spectrum Encoding for Controlling the Functionality of Diffractive Networks8 Jan 2026
- 2024Optical Generative Models23 Oct 2024
- 2024Unidirectional imaging with partially coherent light10 Aug 2024
- 2024Integration of Programmable Diffraction with Digital Neural Networks15 Jun 2024
- 2024Training of Physical Neural Networks5 Jun 2024
- 2024Multiplane Quantitative Phase Imaging Using a Wavelength-Multiplexed Diffractive Optical Processor16 Mar 2024
- 2024Multiplexed all-optical permutation operations using a reconfigurable diffractive optical network4 Feb 2024
- 2024All-optical complex field imaging using diffractive processors30 Jan 2024
- 2024Information hiding cameras: optical concealment of object information into ordinary images15 Jan 2024
- 2023All-Optical Phase Conjugation Using Diffractive Wavefront Processing8 Nov 2023
9 more
- 2023All-optical image denoising using a diffractive visual processor17 Sep 2023
- 2023Pyramid diffractive optical networks for unidirectional image magnification and demagnification29 Aug 2023
- 2023On the use of deep learning for phase recovery2 Aug 2023
- 2023The Need for Inherently Privacy-Preserving Vision in Trustworthy Autonomous Systems29 Mar 2023
- 2022Snapshot Multispectral Imaging Using a Diffractive Optical Network10 Dec 2022
- 2022Unidirectional Imaging using Deep Learning-Designed Materials5 Dec 2022
- 2022Time-lapse image classification using a diffractive neural network23 Aug 2022
- 2022All-optical image classification through unknown random diffusers using a single-pixel diffractive network8 Aug 2022
- 2022Diffractive Interconnects: All-Optical Permutation Operation Using Diffractive Networks21 Jun 2022
- 2024Training of Physical Neural Networkscited by 49
- 2023On the use of deep learning for phase recoverycited by 20
- 2022Snapshot Multispectral Imaging Using a Diffractive Optical Networkcited by 16
- 2022Unidirectional Imaging using Deep Learning-Designed Materialscited by 13
- 2023All-Optical Phase Conjugation Using Diffractive Wavefront Processingcited by 8
- 2024Optical Generative Modelscited by 8
- 2022Diffractive Interconnects: All-Optical Permutation Operation Using Diffractive Networkscited by 6
- 2023All-optical image denoising using a diffractive visual processorcited by 6
- 2024Information hiding cameras: optical concealment of object information into ordinary imagescited by 6
- 2022All-optical image classification through unknown random diffusers using a single-pixel diffractive networkcited by 5
- 2022Time-lapse image classification using a diffractive neural networkcited by 4
- 2023Pyramid diffractive optical networks for unidirectional image magnification and demagnificationcited by 3
12 most cited of 21 All 21 (JSON)
- 2026Wavelength-Multiplexed 2D Beam Steering via a Passive Diffractive Network15 Jun 2026
- 2026Wavelength-multiplexed massively parallel diffractive optical information storage and image projection3 Apr 2026
- 2026Illumination Angular Spectrum Encoding for Controlling the Functionality of Diffractive Networks8 Jan 2026
- 2024Optical Generative Models23 Oct 2024
- 2024Unidirectional imaging with partially coherent light10 Aug 2024
- 2024Integration of Programmable Diffraction with Digital Neural Networks15 Jun 2024
- 2024Training of Physical Neural Networks5 Jun 2024
- 2024Multiplane Quantitative Phase Imaging Using a Wavelength-Multiplexed Diffractive Optical Processor16 Mar 2024
- 2024Multiplexed all-optical permutation operations using a reconfigurable diffractive optical network4 Feb 2024
- 2024All-optical complex field imaging using diffractive processors30 Jan 2024
- 2024Information hiding cameras: optical concealment of object information into ordinary images15 Jan 2024
- 2023All-Optical Phase Conjugation Using Diffractive Wavefront Processing8 Nov 2023
12 newest of 21 All 21 (JSON)