mlsanityData to 14 Oct 2026

Photonic Accelerators for Image Segmentation in Autonomous Driving and Defect Detection

arXiv 2309.16783 ↗First posted 28 Sep 2023cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Photonic computing promises faster and more energy-efficient deep neural network (DNN) inference than traditional digital hardware. Advances in photonic computing can have profound impacts on applications such as autonomous driving and defect detection that depend on fast, accurate and energy efficient execution of image segmentation models. In this paper, we investigate image segmentation on photonic accelerators to explore: a) the types of image segmentation DNN architectures that are best suited for photonic accelerators, and b) the throughput and energy efficiency of executing the different image segmentation models on photonic accelerators, along with the trade-offs involved therein. Specifically, we demonstrate that certain segmentation models exhibit negligible loss in accuracy (compared to digital float32 models) when executed on photonic accelerators, and explore the empirical reasoning for their robustness. We also discuss techniques for recovering accuracy in the case of models that do not perform well. Further, we compare throughput (inferences-per-second) and energy consumption estimates for different image segmentation workloads on photonic accelerators. We discuss the challenges and potential optimizations that can help improve the application of photonic accelerators to such computer vision tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 53 references that are in the map. First posted on arXiv 28 Sep 2023.

Builds on

22 of 53 references.

References · 22

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2023Segment Anythingcited by 8,234
  5. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  6. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,868
  7. 2016Neural Architecture Search with Reinforcement Learningcited by 1,499
  8. 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,152
  9. 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,069
  10. 2021A Survey of Quantization Methods for Efficient Neural Network Inferencecited by 815
  11. 2017In-Datacenter Performance Analysis of a Tensor Processing Unitcited by 618
  12. 2018PACT: Parameterized Clipping Activation for Quantized Neural Networkscited by 467
10 more
  1. 2021Pruning and Quantization for Deep Neural Network Acceleration: A Surveycited by 263
  2. 2020Integer Quantization for Deep Learning Inference: Principles and Empirical Evaluationcited by 188
  3. 2021VS-Quant: Per-vector Scaled Quantization for Accurate Low-Precision Neural Network Inferencecited by 64
  4. 2021An Electro-Photonic System for Accelerating Deep Neural Networkscited by 15
  5. 2022Real-time semantic segmentation on FPGAs for autonomous vehicles with hls4mlcited by 11
  6. 2018PCNNA: A Photonic Convolutional Neural Network Acceleratorcited by 8
  7. 2022On Efficient Real-Time Semantic Segmentation: A Surveycited by 7
  8. 2022Semantic Segmentation for Autonomous Driving: Model Evaluation, Dataset Generation, Perspective Comparison, and Real-Time Capabilitycited by 7
  9. 2017Low-memory GEMM-based convolution algorithms for deep neural networkscited by 6
  10. 2022Adaptive Block Floating-Point for Analog Deep Learning Hardwarecited by 4

Built on by

Not cited yet.