mlsanityData to 7 Oct 2026

Raw or Cooked? Object Detection on RAW Images

arXiv 2301.08965 ↗First posted 21 Jan 2023cs.CV cs.LGcited by 14

Not on the map. Why?

Abstract (arXiv)

Images fed to a deep neural network have in general undergone several handcrafted image signal processing (ISP) operations, all of which have been optimized to produce visually pleasing images. In this work, we investigate the hypothesis that the intermediate representation of visually pleasing images is sub-optimal for downstream computer vision tasks compared to the RAW image representation. We suggest that the operations of the ISP instead should be optimized towards the end task, by learning the parameters of the operations jointly during training. We extend previous works on this topic and propose a new learnable operation that enables an object detector to achieve superior performance when compared to both previous works and traditional RGB images. In experiments on the open PASCALRAW dataset, we empirically confirm our hypothesis.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 24 of its 52 references that are in the map. First posted on arXiv 21 Jan 2023.

Builds on

24 of 52 references.

References · 24

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  5. 2020End-to-End Object Detection with Transformerscited by 7,384
  6. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  7. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
  8. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  9. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  10. 2018YOLOv3: An Incremental Improvementcited by 2,652
  11. 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
  12. 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,573
12 more
  1. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
  2. 2019Objects as Pointscited by 1,172
  3. 2021Conditional DETR for Fast Training Convergencecited by 422
  4. 2020Rethinking Transformer-based Set Prediction for Object Detectioncited by 156
  5. 2020Replacing Mobile Camera ISP with a Single Deep Learning Modelcited by 108
  6. 2021Learning RAW-to-sRGB Mappings with Inaccurately Aligned Supervisioncited by 43
  7. 2020AWNet: Attentive Wavelet Network for Image ISPcited by 38
  8. 2017Reconfiguring the Imaging Pipeline for Computer Visioncited by 32
  9. 2022DynamicISP: Dynamically Controlled Image Signal Processor for Image Recognitioncited by 23
  10. 2022GenISP: Neural ISP for Low-Light Machine Cognitioncited by 22
  11. 2022Rawgment: Noise-Accounted RAW Augmentation Enables Recognition in a Wide Variety of Environmentscited by 18
  12. 2022Transform your Smartphone into a DSLR Camera: Learning the ISP in the Wildcited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 5; 2025: 6; 2026: 2.

14 papers.

Sort:

By area: