Raw or Cooked? Object Detection on RAW Images
Not on the map. Why?
Abstract (arXiv)
Images fed to a deep neural network have in general undergone several handcrafted image signal processing (ISP) operations, all of which have been optimized to produce visually pleasing images. In this work, we investigate the hypothesis that the intermediate representation of visually pleasing images is sub-optimal for downstream computer vision tasks compared to the RAW image representation. We suggest that the operations of the ISP instead should be optimized towards the end task, by learning the parameters of the operations jointly during training. We extend previous works on this topic and propose a new learnable operation that enables an object detector to achieve superior performance when compared to both previous works and traditional RGB images. In experiments on the open PASCALRAW dataset, we empirically confirm our hypothesis.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 24 of its 52 references that are in the map. First posted on arXiv 21 Jan 2023.
Builds on
24 of 52 references.
References · 24
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2018YOLOv3: An Incremental Improvementcited by 2,652
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,573
12 more
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
- 2019Objects as Pointscited by 1,172
- 2021Conditional DETR for Fast Training Convergencecited by 422
- 2020Rethinking Transformer-based Set Prediction for Object Detectioncited by 156
- 2020Replacing Mobile Camera ISP with a Single Deep Learning Modelcited by 108
- 2021Learning RAW-to-sRGB Mappings with Inaccurately Aligned Supervisioncited by 43
- 2020AWNet: Attentive Wavelet Network for Image ISPcited by 38
- 2017Reconfiguring the Imaging Pipeline for Computer Visioncited by 32
- 2022DynamicISP: Dynamically Controlled Image Signal Processor for Image Recognitioncited by 23
- 2022GenISP: Neural ISP for Low-Light Machine Cognitioncited by 22
- 2022Rawgment: Noise-Accounted RAW Augmentation Enables Recognition in a Wide Variety of Environmentscited by 18
- 2022Transform your Smartphone into a DSLR Camera: Learning the ISP in the Wildcited by 9
Built on by
Citing papers per year: 2023: 1; 2024: 5; 2025: 6; 2026: 2.
14 papers.
Sort:
By area:
- 2024AdaptiveISP: Learning an Adaptive Image Signal Processor for Object Detectioncited by 18
- 2024RAW-Diffusion: RGB-Guided Diffusion Models for High-Fidelity RAW Image Generationcited by 8
- 2025Dark-ISP: Enhancing RAW Image Processing for Low-Light Object Detectioncited by 5
- 2025Beyond RGB: Adaptive Parallel Processing for RAW Object Detectioncited by 4
- 2024A Learnable Color Correction Matrix for RAW Reconstructioncited by 3
- 2024Leveraging Content and Context Cues for Low-Light Image Enhancementcited by 2
- 2025SimROD: A Simple Baseline for Raw Object Detection with Global and Local Enhancementscited by 2
- 2025Rethinking Image Histogram Matching for Image Classificationcited by 2
- 2025γ-Quant: Towards Learnable Quantization for Low-bit Pattern Recognitioncited by 2
- 2026RAWDet-7: A Multi-Scenario Benchmark for Object Detection and Description on Quantized RAW Imagescited by 1
- 2023Semantic and Articulated Pedestrian Sensing Onboard a Moving Vehiclecited by 0
- 2024Raw Instinct: Trust Your Classifiers and Skip the Conversioncited by 0
2 more
- 2026Real-Time Scene-Adaptive Tone Mapping for High-Dynamic Range Object Detection31 Aug 2026
- 2026RAWDet-7: A Multi-Scenario Benchmark for Object Detection and Description on Quantized RAW Images3 Feb 2026
- 2025γ-Quant: Towards Learnable Quantization for Low-bit Pattern Recognition26 Sep 2025
- 2025Dark-ISP: Enhancing RAW Image Processing for Low-Light Object Detection11 Sep 2025
- 2025Spatial-Frequency Aware for Object Detection in RAW Image2 Aug 2025
- 2025Rethinking Image Histogram Matching for Image Classification2 Jun 2025
- 2025Beyond RGB: Adaptive Parallel Processing for RAW Object Detection17 Mar 2025
- 2025SimROD: A Simple Baseline for Raw Object Detection with Global and Local Enhancements10 Mar 2025
- 2024Leveraging Content and Context Cues for Low-Light Image Enhancement10 Dec 2024
- 2024RAW-Diffusion: RGB-Guided Diffusion Models for High-Fidelity RAW Image Generation20 Nov 2024
- 2024AdaptiveISP: Learning an Adaptive Image Signal Processor for Object Detection30 Oct 2024
- 2024A Learnable Color Correction Matrix for RAW Reconstruction4 Sep 2024
2 more
- 2024AdaptiveISP: Learning an Adaptive Image Signal Processor for Object Detectioncited by 18
- 2025Dark-ISP: Enhancing RAW Image Processing for Low-Light Object Detectioncited by 5
- 2025Beyond RGB: Adaptive Parallel Processing for RAW Object Detectioncited by 4
- 2024A Learnable Color Correction Matrix for RAW Reconstructioncited by 3
- 2024Leveraging Content and Context Cues for Low-Light Image Enhancementcited by 2
- 2025SimROD: A Simple Baseline for Raw Object Detection with Global and Local Enhancementscited by 2
- 2025Rethinking Image Histogram Matching for Image Classificationcited by 2
- 2025γ-Quant: Towards Learnable Quantization for Low-bit Pattern Recognitioncited by 2
- 2026RAWDet-7: A Multi-Scenario Benchmark for Object Detection and Description on Quantized RAW Imagescited by 1
- 2023Semantic and Articulated Pedestrian Sensing Onboard a Moving Vehiclecited by 0
- 2024Raw Instinct: Trust Your Classifiers and Skip the Conversioncited by 0
- 2025Spatial-Frequency Aware for Object Detection in RAW Imagecited by 0
12 most cited of 13 All 13 (JSON)
- 2026Real-Time Scene-Adaptive Tone Mapping for High-Dynamic Range Object Detection31 Aug 2026
- 2026RAWDet-7: A Multi-Scenario Benchmark for Object Detection and Description on Quantized RAW Images3 Feb 2026
- 2025γ-Quant: Towards Learnable Quantization for Low-bit Pattern Recognition26 Sep 2025
- 2025Dark-ISP: Enhancing RAW Image Processing for Low-Light Object Detection11 Sep 2025
- 2025Spatial-Frequency Aware for Object Detection in RAW Image2 Aug 2025
- 2025Rethinking Image Histogram Matching for Image Classification2 Jun 2025
- 2025Beyond RGB: Adaptive Parallel Processing for RAW Object Detection17 Mar 2025
- 2025SimROD: A Simple Baseline for Raw Object Detection with Global and Local Enhancements10 Mar 2025
- 2024Leveraging Content and Context Cues for Low-Light Image Enhancement10 Dec 2024
- 2024AdaptiveISP: Learning an Adaptive Image Signal Processor for Object Detection30 Oct 2024
- 2024A Learnable Color Correction Matrix for RAW Reconstruction4 Sep 2024
- 2024Raw Instinct: Trust Your Classifiers and Skip the Conversion21 Mar 2024
12 newest of 13 All 13 (JSON)