De-occluding broadband metalens
Not on the map. Why?
Abstract (arXiv)
Obstructions such as raindrops, fences, or dust degrade captured images, especially when mechanical cleaning is infeasible. Conventional solutions to obstructions rely on a bulky compound optics array or computational inpainting, which compromise compactness or fidelity. Metalenses composed of subwavelength meta-atoms promise compact imaging, but simultaneous achievement of broadband and obstruction-free imaging remains a challenge, since a metalens that images distant scenes across a broadband spectrum cannot properly defocus near-depth occlusions. Here, we introduce a learned split-spectrum metalens that enables broadband obstruction-free imaging. Our approach divides the spectrum of each RGB channel into pass and stop bands with multi-band spectral filtering and learns the metalens to focus light from far objects through pass bands, while filtering focused near-depth light through stop bands. This optical signal is further enhanced using a neural network. Our learned split-spectrum metalens achieves broadband and obstruction-free imaging with relative PSNR gains of 32.29% and improves object detection and semantic segmentation accuracies with absolute gains of +13.54% mAP, +48.45% IoU, and +20.35% mIoU over a conventional hyperbolic design. This promises robust obstruction-free sensing and vision for space-constrained systems, such as mobile robots, drones, and endoscopes.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 60 references that are in the map. First posted on arXiv 27 Jan 2026.
Builds on
13 of 60 references.
References · 13
- 2017Attention Is All You Needcited by 59,932
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2019Kvasir-SEG: A Segmented Polyp Datasetcited by 588
- 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 479
- 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 414
- 2020Detection and Tracking Meet Drones Challengecited by 261
- 2020Single-shot Hyperspectral-Depth Imaging with Learned Diffractive Opticscited by 39
- 2023ParamISP: Learned Forward and Inverse ISPs using Camera Parameterscited by 23
- 2018An Optical Frontend for a Convolutional Neural Networkcited by 18
- 2024UAV-Rain1k: A Benchmark for Raindrop Removal from UAV Aerial Imagerycited by 15
- 2019SoilingNet: Soiling Detection on Automotive Surround-View Camerascited by 14
- 2021Through-Foliage Tracking with Airborne Optical Sectioningcited by 13
Built on by
Not cited yet.