mlsanityData to 14 Oct 2026

SoDaCam: Software-defined Cameras via Single-Photon Imaging

arXiv 2309.00066 ↗First posted 31 Aug 2023cs.CV eess.IVcited by 10

Not on the map. Why?

Abstract (arXiv)

Reinterpretable cameras are defined by their post-processing capabilities that exceed traditional imaging. We present "SoDaCam" that provides reinterpretable cameras at the granularity of photons, from photon-cubes acquired by single-photon devices. Photon-cubes represent the spatio-temporal detections of photons as a sequence of binary frames, at frame-rates as high as 100 kHz. We show that simple transformations of the photon-cube, or photon-cube projections, provide the functionality of numerous imaging systems including: exposure bracketing, flutter shutter cameras, video compressive systems, event cameras, and even cameras that move during exposure. Our photon-cube projections offer the flexibility of being software-defined constructs that are only limited by what is computable, and shot-noise. We exploit this flexibility to provide new capabilities for the emulated cameras. As an added benefit, our projections provide camera-dependent compression of photon-cubes, which we demonstrate using an implementation of our projections on a novel compute architecture that is designed for single-photon imaging.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 29 of its 100 references that are in the map. First posted on arXiv 31 Aug 2023.

Builds on

29 of 100 references.

References · 29

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  3. 2020Plug-and-Play Image Restoration with Deep Denoiser Priorcited by 470
  4. 2018Unsupervised Event-based Learning of Optical Flow, Depth, and Egomotioncited by 307
  5. 2016Plug-and-Play ADMM for Image Restoration: Fixed Point Convergence and Applicationscited by 246
  6. 2018Event-based Vision meets Deep Learning on Steering Prediction for Self-driving Carscited by 200
  7. 2019Events-to-Video: Bringing Modern Computer Vision to Event Camerascited by 193
  8. 2018A Unifying Contrast Maximization Framework for Event Cameras, with Applications to Motion, Depth, and Optical Flow Estimationcited by 178
  9. 2021TimeLens: Event-based Video Frame Interpolationcited by 151
  10. 2019FastDVDnet: Towards Real-Time Deep Video Denoising Without Flow Estimationcited by 128
  11. 2018Asynchronous, Photometric Feature Tracking using Events and Framescited by 118
  12. 2018Rank Minimization for Snapshot Compressive Imagingcited by 99
17 more
  1. 2022Event-aided Direct Sparse Odometrycited by 92
  2. 2021Object Tracking by Jointly Exploiting Frame and Event Domaincited by 84
  3. 2019Deep Optics for Single-shot High-dynamic-range Imagingcited by 62
  4. 2022Learning Dense and Continuous Optical Flow from an Event Cameracited by 60
  5. 2013Coded aperture compressive temporal imagingcited by 57
  6. 2021Plug-and-Play Algorithms for Video Snapshot Compressive Imagingcited by 42
  7. 2021Dense Deep Unfolding Network with 3D-CNN Prior for Snapshot Compressive Imagingcited by 31
  8. 2021MetaSCI: Scalable and Adaptive Reconstruction for Video Compressive Sensingcited by 29
  9. 2019A megapixel time-gated SPAD image sensor for 2D and 3D imaging applicationscited by 28
  10. 2020Quanta Burst Photographycited by 25
  11. 2019High Flux Passive Imaging with Single-Photon Sensorscited by 23
  12. 2021Passive Inter-Photon Imagingcited by 16
  13. 2021Unraveling the paradox of intensity-dependent DVS pixel noisecited by 16
  14. 2021HDR Video Reconstruction with Tri-Exposure Quad-Bayer Sensorscited by 13
  15. 2020Motion Adaptive Deblurring with Single-Photon Camerascited by 11
  16. 2022Ensemble learning priors unfolding for scalable Snapshot Compressive Sensingcited by 9
  17. 2020A Unified Framework for Compressive Video Recovery from Coded Exposure Techniquescited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 6; 2025: 1; 2026: 3.

10 papers.

  1. 2024Generalized Event Camerascited by 7
  2. 2024Time-Resolved MNIST Dataset for Single-Photon Recognitioncited by 4
  3. 2024Streaming quanta sensors for online, high-performance imaging and visioncited by 3
  4. 2024Radiance Fields from Photonscited by 3
  5. 2024Photon Inhibition for Energy-Efficient Single-Photon Imagingcited by 1
  6. 2024Spiking Neural Network Enhanced Hand Gesture Recognition Using Low-Cost Single-photon Avalanche Diode Arraycited by 0
  7. 2025Hardware-aware Coding Function Design for Compressive Single-Photon 3D Camerascited by 0
  8. 2026Accurate Simulation Pipeline for Passive Single-Photon Imagingcited by 0
  9. 2026Computer Vision with a Superpixelation Cameracited by 0
  10. 2026Optical Flow from Photonscited by 0