mlsanityData to 7 Oct 2026

Training deep physical neural networks with local physical information bottleneck

arXiv 2602.09569 ↗First posted 10 Feb 2026cs.LG physics.app-phcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep learning has revolutionized modern society but faces growing energy and latency constraints. Deep physical neural networks (PNNs) are interconnected computing systems that directly exploit analog dynamics for energy-efficient, ultrafast AI execution. Realizing this potential, however, requires universal training methods tailored to physical intricacies. Here, we present the Physical Information Bottleneck (PIB), a general and efficient framework that integrates information theory and local learning, enabling deep PNNs to learn under arbitrary physical dynamics. By allocating matrix-based information bottlenecks to each unit, we demonstrate supervised, unsupervised, and reinforcement learning across electronic memristive chips and optical computing platforms. PIB also adapts to severe hardware faults and allows for parallel training via geographically distributed resources. Bypassing auxiliary digital models and contrastive measurements, PIB recasts PNN training as an intrinsic, scalable information-theoretic process compatible with diverse physical substrates.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 65 references that are in the map. First posted on arXiv 10 Feb 2026.

Builds on

27 of 65 references.

References · 27

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  2. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
  3. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
  4. 2022Emergent Abilities of Large Language Modelscited by 2,483
  5. 2015Deep Learning and the Information Bottleneck Principlecited by 793
  6. 2022The Forward-Forward Algorithm: Some Preliminary Investigationscited by 262
  7. 2016Equilibrium Propagation: Bridging the Gap Between Energy-Based Models and Backpropagationcited by 251
  8. 2021Deep physical neural networks enabled by a backpropagation algorithm for arbitrary physical systemscited by 125
  9. 2018Greedy Layerwise Learning Can Scale to ImageNetcited by 113
  10. 2016Neuromorphic Silicon Photonic Networkscited by 66
  11. 2024Training of Physical Neural Networkscited by 47
  12. 2022Experimentally realized in situ backpropagation for deep learning in nanophotonic neural networkscited by 43
15 more
  1. 2023Backpropagation-free Training of Deep Physical Neural Networkscited by 42
  2. 2019Explaining a black-box using Deep Variational Information Bottleneck Approachcited by 35
  3. 2023The physics of optical computingcited by 33
  4. 2021Self-learning Machines based on Hamiltonian Echo Backpropagationcited by 28
  5. 2020Scaling Down Deep Learning with MNIST-1Dcited by 23
  6. 2025From Tokens to Thoughts: How LLMs and Humans Trade Compression for Meaningcited by 23
  7. 2023Forward-Forward Training of an Optical Neural Networkcited by 19
  8. 2021Silicon Photonic Architecture for Training Deep Neural Networks with Direct Feedback Alignmentcited by 17
  9. 2022Hybrid training of optical neural networkscited by 15
  10. 2014Trainable and Dynamic Computing: Error Backpropagation through Physical Mediacited by 9
  11. 2023Information decomposition in complex systems via machine learningcited by 9
  12. 2021LightOn Optical Processing Unit: Scaling-up AI and HPC with a Non von Neumann co-processorcited by 5
  13. 2025Model-free front-to-end training of a large high performance laser neural networkcited by 4
  14. 2023Harnessing Synthetic Active Particles for Physical Reservoir Computingcited by 3
  15. 2024Perfecting Imperfect Physical Neural Networks with Transferable Robustness using Sharpness-Aware Trainingcited by 2

Built on by

Not cited yet.