mlsanityData to 14 Oct 2026

Curriculum Learning for ab initio Deep Learned Refractive Optics

arXiv 2302.01089 ↗First posted 2 Feb 2023cs.CV cs.LG eess.IVcited by 32

Not on the map. Why?

Abstract (arXiv)

Deep optical optimization has recently emerged as a new paradigm for designing computational imaging systems using only the output image as the objective. However, it has been limited to either simple optical systems consisting of a single element such as a diffractive optical element (DOE) or metalens, or the fine-tuning of compound lenses from good initial designs. Here we present a DeepLens design method based on curriculum learning, which is able to learn optical designs of compound lenses ab initio from randomly initialized surfaces without human intervention, therefore overcoming the need for a good initial design. We demonstrate the effectiveness of our approach by fully automatically designing both classical imaging lenses and a large field-of-view extended depth-of-field computational lens in a cellphone-style form factor, with highly aspheric surfaces and a short back focal length.

Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Builds on 12 of its 57 references that are in the map. First posted on arXiv 2 Feb 2023.

Builds on

12 of 57 references.

References · 12

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
  3. 2022Simple Baselines for Image Restorationcited by 708
  4. 2017Automated Curriculum Learning for Neural Networkscited by 257
  5. 2019Deep Optics for Monocular Depth Estimation and 3D Object Detectioncited by 65
  6. 2019Deep Optics for Single-shot High-dynamic-range Imagingcited by 62
  7. 2020Single-shot Hyperspectral-Depth Imaging with Learned Diffractive Opticscited by 39
  8. 2020Light Stage Super-Resolution: Continuous High-Frequency Relightingcited by 20
  9. 2022The Differentiable Lens: Compound Lens Search over Glass Surfaces and Materials for Object Detectioncited by 15
  10. 2021Mask-ToF: Learning Microlens Masks for Flying Pixel Correction in Time-of-Flight Imagingcited by 9
  11. 2022Hybrid Diffractive Optics Design via Hardware-in-the-Loop Methodology for Achromatic Extended-Depth-of-Field Imagingcited by 7
  12. 2019Learning Wavefront Coding for Extended Depth of Field Imagingcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 4; 2024: 7; 2025: 12; 2026: 9.

32 papers.

Sort:

By area:

  1. 2023Minimalist and High-Quality Panoramic Imaging with PSF-aware Transformerscited by 13
  2. 2023Aberration-Aware Depth-from-Focuscited by 12
  3. 2024End-to-End Hybrid Refractive-Diffractive Lens Design with Differentiable Ray-Wave Modelcited by 11
  4. 2023Task-Driven Lens Designcited by 9
  5. 2024Exploring Quasi-Global Solutions to Compound Lens Based Computational Imaging Systemscited by 7
  6. 2023Revealing the preference for correcting separated aberrations in joint optic-image designcited by 6
  7. 2024OmniLens: Towards Universal Lens Aberration Correction via LensLib-to-Specific Domain Adaptationcited by 4
  8. 2025Efficient Depth- and Spatially-Varying Image Simulation for Defocus Deblurcited by 4
  9. 2024Surround-View Fisheye Optics in Computer Vision and Simulation: Survey and Challengescited by 3
  10. 2024Successive optimization of optics and post-processing with differentiable coherent PSF operator and field informationcited by 3
  11. 2026OPTIAGENT: A Physics-Driven Agentic Framework for Automated Optical Designcited by 3
  12. 2024TaCOS: Task-Specific Camera Optimization with Simulationcited by 2
20 more
  1. 2025EventTracer: Fast Path Tracing-based Event Stream Renderingcited by 2
  2. 2025Neuro-inspired automated lens designcited by 2
  3. 2026Socratic agents for autonomous scientific discovery in high-dimensional physical systemscited by 2
  4. 2025Simulating Dual-Pixel Images From Ray Tracing For Depth Estimationcited by 1
  5. 2025Fovea Stacking: Imaging with Dynamic Localized Aberration Correctioncited by 1
  6. 2025Collaborative On-Sensor Array Camerascited by 1
  7. 2025Learned Off-aperture Encoding for Wide Field-of-view RGBD Imagingcited by 1
  8. 2026End-to-end differentiable design of geometric waveguide displayscited by 1
  9. 2024Neural Dynamic Data Valuation via Stochastic State-Adjoint Trajectoriescited by 0
  10. 2025Large-Area Fabrication-Aware Computational Diffractive Opticscited by 0
  11. 2025Automated design of compound lenses with discrete-continuous optimizationcited by 0
  12. 2025JOCA: Task-Driven Joint Optimisation of Camera Hardware and Adaptive Camera Control Algorithmscited by 0
  13. 2025Graph Neural Networks for Interferometer Simulationscited by 0
  14. 2025Learning to Sense for Driving: Joint Optics-Sensor-Model Co-Design for Semantic Segmentationcited by 0
  15. 2026Towards Universal Computational Aberration Correction in Photographic Cameras: A Comprehensive Benchmark Analysiscited by 0
  16. 2026A Differentiable Ray-Wave Framework for Hybrid Refractive-Diffractive System Modeling and Optimizationcited by 0
  17. 2026Beyond Bayer: Task-Optimal Sensor Co-Design for Robust Autonomous-Driving Segmentationcited by 0
  18. 2026Realistic Compound-Lens Defocus Blur Synthesiscited by 0
  19. 2026Does AI Understand Imaging? A Systematic Benchmark of Agentic AI for Computational Imaging Taskscited by 0
  20. 2026LensDesigner: A Self-Improving Agent for Optical Lens Designcited by 0