mlsanityData to 14 Oct 2026

Information Processing Capacity of Stationary Physical Systems: Theory, Data-efficient Estimation Methods, and Photonic Demonstration

arXiv 2605.19152 ↗First posted 18 May 2026stat.ML cs.ET cs.ITcited by 0

Not on the map. Why?

Abstract (arXiv)

Physical computing systems provide a promising route toward hardware-native machine learning, but their computational capabilities remain difficult to characterize in a principled, task-independent, and data-efficient way. We extend the Information Processing Capacity (IPC) framework to stationary physical computing systems and establish several fundamental results: individual capacities are bounded between zero and one, their sum over a complete basis is bounded by the number of readouts, and noise strictly reduces this bound. We address the finite-sample estimation of IPC and derive the asymptotic form of the systematic positive bias affecting naive estimators. Building on these results, we introduce data-efficient estimation methods based on Richardson extrapolation and Sobol quasi-random sampling. We validate the framework experimentally using a photonic computing system based on picosecond laser pulses propagating through a nonlinear optical fibre. By varying the laser power and fibre length, we observe systematic shifts of the IPC distribution toward higher-order nonlinear capacities induced by the Kerr effect. Finally, we demonstrate that the total IPC strongly correlates with performance on benchmark machine-learning tasks and provides a reliable estimate of the effective dimensionality of the system. These results establish IPC as a practical bridge between the intrinsic dynamics of physical computing systems and their machine-learning performance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 61 references that are in the map. First posted on arXiv 18 May 2026.

Builds on

13 of 61 references.

References · 13

  1. 2021Deep physical neural networks enabled by a backpropagation algorithm for arbitrary physical systemscited by 128
  2. 2018Benchmarking Keyword Spotting Efficiency on Neuromorphic Hardwarecited by 37
  3. 2019A Unifying Framework for Information Processing in Stochastically Driven Dynamical Systemscited by 16
  4. 2020Memory and forecasting capacities of nonlinear recurrent networkscited by 11
  5. 2020Deep Time-Delay Reservoir Computing: Dynamics and Memory Capacitycited by 10
  6. 2023Memory of recurrent networks: Do we compute it right?cited by 6
  7. 2018Short-term Memory of Deep RNNcited by 5
  8. 2021Master memory function for delay-based reservoir computers with single-variable dynamicscited by 4
  9. 2020Limitations of the recall capabilities in delay based reservoir computing systemscited by 3
  10. 2025Memory Capacity of Nonlinear Recurrent Networks: Is it Informative?cited by 3
  11. 2025Asymptotic evaluation of the information processing capacity in reservoir computingcited by 3
  12. 2023Deep photonic reservoir computing recurrent networkcited by 2
1 more
  1. 2023Weak Kerr Nonlinearity Boosts the Performance of Frequency-Multiplexed Photonic Extreme Learning Machines: A Multifaceted Approachcited by 2

Built on by

Not cited yet.