mlsanityData to 7 Oct 2026

Exploring Quasi-Global Solutions to Compound Lens Based Computational Imaging Systems

arXiv 2404.19201 ↗First posted 30 Apr 2024eess.IV cs.CV cs.ROcited by 7

Not on the map. Why?

Abstract (arXiv)

Recently, joint design approaches that simultaneously optimize optical systems and downstream algorithms through data-driven learning have demonstrated superior performance over traditional separate design approaches. However, current joint design approaches heavily rely on the manual identification of initial lenses, posing challenges and limitations, particularly for compound lens systems with multiple potential starting points. In this work, we present Quasi-Global Search Optics (QGSO) to automatically design compound lens based computational imaging systems through two parts: (i) Fused Optimization Method for Automatic Optical Design (OptiFusion), which searches for diverse initial optical systems under certain design specifications; and (ii) Efficient Physic-aware Joint Optimization (EPJO), which conducts parallel joint optimization of initial optical systems and image reconstruction networks with the consideration of physical constraints, culminating in the selection of the optimal solution in all search results. Extensive experimental results illustrate that QGSO serves as a transformative end-to-end lens design paradigm for superior global search ability, which automatically provides compound lens based computational imaging systems with higher imaging quality compared to existing paradigms. The source code will be made publicly available at https://github.com/LiGpy/QGSO.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 27 of its 68 references that are in the map. First posted on arXiv 30 Apr 2024.

Builds on

27 of 68 references.

References · 27

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  5. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  6. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
  7. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
  8. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
  9. 2022Simple Baselines for Image Restorationcited by 701
  10. 2018Unprocessing Images for Learned Raw Denoisingcited by 250
  11. 2019Deep Optics for Monocular Depth Estimation and 3D Object Detectioncited by 65
  12. 2019Deep Optics for Single-shot High-dynamic-range Imagingcited by 62
15 more
  1. 2020Single-shot Hyperspectral-Depth Imaging with Learned Diffractive Opticscited by 39
  2. 2023Curriculum Learning for ab initio Deep Learned Refractive Opticscited by 32
  3. 2023Optical Aberration Correction in Postprocessing using Imaging Simulationcited by 18
  4. 2022The Differentiable Lens: Compound Lens Search over Glass Surfaces and Materials for Object Detectioncited by 15
  5. 2023Minimalist and High-Quality Panoramic Imaging with PSF-aware Transformerscited by 13
  6. 2021Deep Coded Aperture Design: An End-to-End Approach for Computational Imaging Taskscited by 12
  7. 2021Mask-ToF: Learning Microlens Masks for Flying Pixel Correction in Time-of-Flight Imagingcited by 9
  8. 2022Annular Computational Imaging: Capture Clear Panoramic Images through Simple Lenscited by 9
  9. 2023Task-Driven Lens Designcited by 9
  10. 2021Computational Imaging and Artificial Intelligence: The Next Revolution of Mobile Visioncited by 7
  11. 2022Hybrid Diffractive Optics Design via Hardware-in-the-Loop Methodology for Achromatic Extended-Depth-of-Field Imagingcited by 7
  12. 2022Computational Imaging for Machine Perception: Transferring Semantic Segmentation beyond Aberrationscited by 7
  13. 2023Mobile Image Restoration via Prior Quantizationcited by 6
  14. 2023Revealing the preference for correcting separated aberrations in joint optic-image designcited by 6
  15. 2024Representing Domain-Mixing Optical Degradation for Real-World Computational Aberration Correction via Vector Quantizationcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 2; 2026: 3.

7 papers.