Curriculum Learning for ab initio Deep Learned Refractive Optics
Not on the map. Why?
Abstract (arXiv)
Deep optical optimization has recently emerged as a new paradigm for designing computational imaging systems using only the output image as the objective. However, it has been limited to either simple optical systems consisting of a single element such as a diffractive optical element (DOE) or metalens, or the fine-tuning of compound lenses from good initial designs. Here we present a DeepLens design method based on curriculum learning, which is able to learn optical designs of compound lenses ab initio from randomly initialized surfaces without human intervention, therefore overcoming the need for a good initial design. We demonstrate the effectiveness of our approach by fully automatically designing both classical imaging lenses and a large field-of-view extended depth-of-field computational lens in a cellphone-style form factor, with highly aspheric surfaces and a short back focal length.
Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Builds on 12 of its 57 references that are in the map. First posted on arXiv 2 Feb 2023.
Builds on
12 of 57 references.
References · 12
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
- 2022Simple Baselines for Image Restorationcited by 708
- 2017Automated Curriculum Learning for Neural Networkscited by 257
- 2019Deep Optics for Monocular Depth Estimation and 3D Object Detectioncited by 65
- 2019Deep Optics for Single-shot High-dynamic-range Imagingcited by 62
- 2020Single-shot Hyperspectral-Depth Imaging with Learned Diffractive Opticscited by 39
- 2020Light Stage Super-Resolution: Continuous High-Frequency Relightingcited by 20
- 2022The Differentiable Lens: Compound Lens Search over Glass Surfaces and Materials for Object Detectioncited by 15
- 2021Mask-ToF: Learning Microlens Masks for Flying Pixel Correction in Time-of-Flight Imagingcited by 9
- 2022Hybrid Diffractive Optics Design via Hardware-in-the-Loop Methodology for Achromatic Extended-Depth-of-Field Imagingcited by 7
- 2019Learning Wavefront Coding for Extended Depth of Field Imagingcited by 6
Built on by
Citing papers per year: 2023: 4; 2024: 7; 2025: 12; 2026: 9.
32 papers.
Sort:
By area:
- 2023Minimalist and High-Quality Panoramic Imaging with PSF-aware Transformerscited by 13
- 2023Aberration-Aware Depth-from-Focuscited by 12
- 2024End-to-End Hybrid Refractive-Diffractive Lens Design with Differentiable Ray-Wave Modelcited by 11
- 2023Task-Driven Lens Designcited by 9
- 2024Exploring Quasi-Global Solutions to Compound Lens Based Computational Imaging Systemscited by 7
- 2023Revealing the preference for correcting separated aberrations in joint optic-image designcited by 6
- 2024OmniLens: Towards Universal Lens Aberration Correction via LensLib-to-Specific Domain Adaptationcited by 4
- 2025Efficient Depth- and Spatially-Varying Image Simulation for Defocus Deblurcited by 4
- 2024Surround-View Fisheye Optics in Computer Vision and Simulation: Survey and Challengescited by 3
- 2024Successive optimization of optics and post-processing with differentiable coherent PSF operator and field informationcited by 3
- 2026OPTIAGENT: A Physics-Driven Agentic Framework for Automated Optical Designcited by 3
- 2024TaCOS: Task-Specific Camera Optimization with Simulationcited by 2
20 more
- 2025EventTracer: Fast Path Tracing-based Event Stream Renderingcited by 2
- 2025Neuro-inspired automated lens designcited by 2
- 2026Socratic agents for autonomous scientific discovery in high-dimensional physical systemscited by 2
- 2025Simulating Dual-Pixel Images From Ray Tracing For Depth Estimationcited by 1
- 2025Fovea Stacking: Imaging with Dynamic Localized Aberration Correctioncited by 1
- 2025Collaborative On-Sensor Array Camerascited by 1
- 2025Learned Off-aperture Encoding for Wide Field-of-view RGBD Imagingcited by 1
- 2026End-to-end differentiable design of geometric waveguide displayscited by 1
- 2024Neural Dynamic Data Valuation via Stochastic State-Adjoint Trajectoriescited by 0
- 2025Large-Area Fabrication-Aware Computational Diffractive Opticscited by 0
- 2025Automated design of compound lenses with discrete-continuous optimizationcited by 0
- 2025JOCA: Task-Driven Joint Optimisation of Camera Hardware and Adaptive Camera Control Algorithmscited by 0
- 2025Graph Neural Networks for Interferometer Simulationscited by 0
- 2025Learning to Sense for Driving: Joint Optics-Sensor-Model Co-Design for Semantic Segmentationcited by 0
- 2026Towards Universal Computational Aberration Correction in Photographic Cameras: A Comprehensive Benchmark Analysiscited by 0
- 2026A Differentiable Ray-Wave Framework for Hybrid Refractive-Diffractive System Modeling and Optimizationcited by 0
- 2026Beyond Bayer: Task-Optimal Sensor Co-Design for Robust Autonomous-Driving Segmentationcited by 0
- 2026Realistic Compound-Lens Defocus Blur Synthesiscited by 0
- 2026Does AI Understand Imaging? A Systematic Benchmark of Agentic AI for Computational Imaging Taskscited by 0
- 2026LensDesigner: A Self-Improving Agent for Optical Lens Designcited by 0
- 2026LensDesigner: A Self-Improving Agent for Optical Lens Design24 Sep 2026
- 2026Does AI Understand Imaging? A Systematic Benchmark of Agentic AI for Computational Imaging Tasks8 Jul 2026
- 2026Realistic Compound-Lens Defocus Blur Synthesis7 Jul 2026
- 2026Socratic agents for autonomous scientific discovery in high-dimensional physical systems25 Jun 2026
- 2026Beyond Bayer: Task-Optimal Sensor Co-Design for Robust Autonomous-Driving Segmentation23 Jun 2026
- 2026A Differentiable Ray-Wave Framework for Hybrid Refractive-Diffractive System Modeling and Optimization14 May 2026
- 2026Towards Universal Computational Aberration Correction in Photographic Cameras: A Comprehensive Benchmark Analysis12 Mar 2026
- 2026OPTIAGENT: A Physics-Driven Agentic Framework for Automated Optical Design27 Feb 2026
- 2026End-to-end differentiable design of geometric waveguide displays7 Jan 2026
- 2025Learning to Sense for Driving: Joint Optics-Sensor-Model Co-Design for Semantic Segmentation23 Dec 2025
- 2025Graph Neural Networks for Interferometer Simulations18 Dec 2025
- 2025JOCA: Task-Driven Joint Optimisation of Camera Hardware and Adaptive Camera Control Algorithms7 Dec 2025
20 more
- 2025Neuro-inspired automated lens design11 Oct 2025
- 2025Automated design of compound lenses with discrete-continuous optimization28 Sep 2025
- 2025EventTracer: Fast Path Tracing-based Event Stream Rendering25 Aug 2025
- 2025Learned Off-aperture Encoding for Wide Field-of-view RGBD Imaging30 Jul 2025
- 2025Efficient Depth- and Spatially-Varying Image Simulation for Defocus Deblur1 Jul 2025
- 2025Collaborative On-Sensor Array Cameras4 Jun 2025
- 2025Fovea Stacking: Imaging with Dynamic Localized Aberration Correction31 May 2025
- 2025Large-Area Fabrication-Aware Computational Diffractive Optics28 May 2025
- 2025Simulating Dual-Pixel Images From Ray Tracing For Depth Estimation14 Mar 2025
- 2024Successive optimization of optics and post-processing with differentiable coherent PSF operator and field information19 Dec 2024
- 2024OmniLens: Towards Universal Lens Aberration Correction via LensLib-to-Specific Domain Adaptation9 Sep 2024
- 2024End-to-End Hybrid Refractive-Diffractive Lens Design with Differentiable Ray-Wave Model2 Jun 2024
- 2024Neural Dynamic Data Valuation via Stochastic State-Adjoint Trajectories30 Apr 2024
- 2024Exploring Quasi-Global Solutions to Compound Lens Based Computational Imaging Systems30 Apr 2024
- 2024TaCOS: Task-Specific Camera Optimization with Simulation17 Apr 2024
- 2024Surround-View Fisheye Optics in Computer Vision and Simulation: Survey and Challenges19 Feb 2024
- 2023Revealing the preference for correcting separated aberrations in joint optic-image design8 Sep 2023
- 2023Minimalist and High-Quality Panoramic Imaging with PSF-aware Transformers22 Jun 2023
- 2023Task-Driven Lens Design26 May 2023
- 2023Aberration-Aware Depth-from-Focus8 Mar 2023
- 2023Minimalist and High-Quality Panoramic Imaging with PSF-aware Transformerscited by 13
- 2023Aberration-Aware Depth-from-Focuscited by 12
- 2024End-to-End Hybrid Refractive-Diffractive Lens Design with Differentiable Ray-Wave Modelcited by 11
- 2023Task-Driven Lens Designcited by 9
- 2024Exploring Quasi-Global Solutions to Compound Lens Based Computational Imaging Systemscited by 7
- 2023Revealing the preference for correcting separated aberrations in joint optic-image designcited by 6
- 2024OmniLens: Towards Universal Lens Aberration Correction via LensLib-to-Specific Domain Adaptationcited by 4
- 2025Efficient Depth- and Spatially-Varying Image Simulation for Defocus Deblurcited by 4
- 2024Surround-View Fisheye Optics in Computer Vision and Simulation: Survey and Challengescited by 3
- 2024Successive optimization of optics and post-processing with differentiable coherent PSF operator and field informationcited by 3
- 2024TaCOS: Task-Specific Camera Optimization with Simulationcited by 2
- 2025EventTracer: Fast Path Tracing-based Event Stream Renderingcited by 2
12 most cited of 29 All 29 (JSON)
- 2026LensDesigner: A Self-Improving Agent for Optical Lens Design24 Sep 2026
- 2026Realistic Compound-Lens Defocus Blur Synthesis7 Jul 2026
- 2026Socratic agents for autonomous scientific discovery in high-dimensional physical systems25 Jun 2026
- 2026Beyond Bayer: Task-Optimal Sensor Co-Design for Robust Autonomous-Driving Segmentation23 Jun 2026
- 2026A Differentiable Ray-Wave Framework for Hybrid Refractive-Diffractive System Modeling and Optimization14 May 2026
- 2026Towards Universal Computational Aberration Correction in Photographic Cameras: A Comprehensive Benchmark Analysis12 Mar 2026
- 2026End-to-end differentiable design of geometric waveguide displays7 Jan 2026
- 2025Graph Neural Networks for Interferometer Simulations18 Dec 2025
- 2025JOCA: Task-Driven Joint Optimisation of Camera Hardware and Adaptive Camera Control Algorithms7 Dec 2025
- 2025Neuro-inspired automated lens design11 Oct 2025
- 2025Automated design of compound lenses with discrete-continuous optimization28 Sep 2025
- 2025EventTracer: Fast Path Tracing-based Event Stream Rendering25 Aug 2025
12 newest of 29 All 29 (JSON)