Dual-Integrated Low-Latency Single-Lens Infrared Computational Imaging for Object Detection
Not on the map. Why?
Abstract (arXiv)
Computational imaging enables compact infrared systems, but deep-learning pipelines that combine image reconstruction and object detection often introduce substantial inference latency. Most existing acceleration strategies compress the reconstruction network while overlooking physical priors from the optical path, leaving a trade-off between accuracy and speed. We present Physics-aware Dual-Integrated Network (PDI-Net), a low-latency framework that integrates infrared reconstruction with object detection and further embeds optical priors into the learning process. PDI-Net uses a supervised U-Net during training, while a semi-U-Net encoder shares features directly with a YOLO-based detector during inference, avoiding full image reconstruction. To bridge the gap between fidelity-oriented reconstruction features and detection-oriented semantics, we introduce a physics-aware large-small bridge (PALS-Bridge), which uses field-dependent point spread function priors to adaptively modulate multiscale convolutional branches. A physics-informed optical degradation simulation pipeline is also developed for training and validation. The method is deployed on a single-lens infrared camera, reducing system weight by about 50% compared with traditional multi-lens designs. On the M3FD benchmark under low-SNR conditions, PDI-Net reduces inference time by 84.06% compared with the Rec+Det with pruning strategy while improving [email protected]:0.95 by 5.07%. These results demonstrate compact, low-latency computational infrared imaging for real-time object detection on resource-constrained platforms.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 60 references that are in the map. First posted on arXiv 21 May 2026.
Builds on
29 of 60 references.
References · 29
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2015Fast R-CNNcited by 2,930
- 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,291
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
- 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,064
- 2018Efficient Neural Architecture Search via Parameter Sharingcited by 831
- 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 508
- 2016DehazeNet: An End-to-End System for Single Image Haze Removalcited by 313
- 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 313
17 more
- 2021Image-Adaptive YOLO for Object Detection in Adverse Weather Conditionscited by 85
- 2021Network Quantization with Element-wise Gradient Scalingcited by 82
- 2018Denoising Prior Driven Deep Neural Network for Image Restorationcited by 80
- 2022Multitask AET with Orthogonal Tangent Regularity for Dark Object Detectioncited by 59
- 2017DiffuserCam: Lensless Single-exposure 3D Imagingcited by 51
- 2017Lensless computational imaging through deep learningcited by 44
- 2017When Image Denoising Meets High-Level Vision Tasks: A Deep Learning Approachcited by 42
- 2018Connecting Image Denoising and High-Level Vision Tasks via Deep Learningcited by 39
- 2021Rethinking Deep Image Prior for Denoisingcited by 38
- 2021Multiscale Domain Adaptive YOLO for Cross-Domain Object Detectioncited by 22
- 2023DarkVisionNet: Low-Light Imaging via RGB-NIR Fusion with Deep Inconsistency Priorcited by 19
- 2024ESOD: Efficient Small Object Detection on High-Resolution Imagescited by 15
- 2023Image Deblurring by Exploring In-depth Properties of Transformercited by 10
- 2022RestoreX-AI: A Contrastive Approach towards Guiding Image Restoration via Explainable AI Systemscited by 8
- 2021Computational Imaging and Artificial Intelligence: The Next Revolution of Mobile Visioncited by 7
- 2023OpEnCam: Lensless Optical Encryption Cameracited by 6
- 2023LightRidge: An End-to-end Agile Design Framework for Diffractive Optical Neural Networkscited by 2
Built on by
Not cited yet.