mlsanityData to 14 Oct 2026

Constrained Co-Design for Photonic Bayesian Neural Networks

arXiv 2608.02229 ↗First posted 3 Aug 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Classical neural networks frequently produce overconfident predictions on ambiguous or out-of-distribution (OOD) data, a liability that grows with each AI system deployed in safety-critical real-world scenarios. Bayesian neural networks (BNNs) provide a principled framework for uncertainty-aware prediction by replacing deterministic parameters with probability distributions, but repeated sampling increases latency, memory traffic, and energy consumption. Photonic probabilistic computing offers a promising alternative by exploiting intrinsic optical stochasticity for fast and parallel sampling. However, photonic BNNs are not ideal samplers: analog constraints on quantization, programming error, dynamic range, and representable mean and variance restrict the variational families that can be implemented in hardware. In this work, we study which hardware-imposed constraints limit scalable photonic BNN inference, how these constraints can be represented, and which ranges can be tolerated by photonic BNNs beyond small proof-of-concept networks. We formulate photonic BNN inference as constrained stochastic variational inference and perform a systematic ablation study over stochasticity location, stochasticity modality, quantization, programming error, and mean/variance bounds. From these results, we derive concrete co-design guidelines that distinguish hardware constraints that can be compensated by training from those requiring hardware or architecture intervention. We validate these guidelines under coupled, hardware-realistic constraints on Dirty-MNIST, CIFAR-10, and CINIC-10, using Fashion-MNIST and SVHN as OOD benchmarks, showing that hardware-aware training recovers predictive performance and uncertainty quality whenever the required variational family remains representable, whereas violations of representational limits require targeted hardware modifications.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 38 references that are in the map. First posted on arXiv 3 Aug 2026.

Builds on

13 of 38 references.

References · 13

  1. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
  2. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
  3. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
  4. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
  5. 2016Variational Inference: A Review for Statisticianscited by 1,472
  6. 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,287
  7. 2015Weight Uncertainty in Neural Networkscited by 554
  8. 2020Hands-on Bayesian Neural Networks -- a Tutorial for Deep Learning Userscited by 338
  9. 2021TrivialAugment: Tuning-free Yet State-of-the-Art Data Augmentationcited by 227
  10. 2021Deep physical neural networks enabled by a backpropagation algorithm for arbitrary physical systemscited by 128
  11. 2022Experimentally realized in situ backpropagation for deep learning in nanophotonic neural networkscited by 44
  12. 2021On the Effects of Quantisation on Model Uncertainty in Bayesian Neural Networkscited by 8
1 more
  1. 2025Uncertainty Reasoning with Photonic Bayesian Machinescited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Photonic Quantum-Enhanced Knowledge Distillation
  2. 2026LCAP: Population-Informed Latent Chip Adaptation from Few Output Probes for Photonic Neural Networks
  3. 2024Streamlined optical training of large-scale modern deep learning architectures with direct feedback alignment
  4. 2022NeurOLight: A Physics-Agnostic Neural Operator Enabling Parametric Photonic Device Simulation
  5. 2023QuATON: Quantization Aware Training of Optical Neurons
  6. 2025Physics-guided and fabrication-aware inverse design of photonic devices using diffusion models
  7. 2023SCONNA: A Stochastic Computing Based Optical Accelerator for Ultra-Fast, Energy-Efficient Inference of Integer-Quantized CNNs
  8. 2026SKYLIGHT: A Scalable Hundred-Channel 3D Photonic In-Memory Tensor Core Architecture for Real-time AI Inference