Thermodynamic Computing System for AI Applications
Not on the map. Why?
Abstract (arXiv)
Recent breakthroughs in artificial intelligence (AI) algorithms have highlighted the need for novel computing hardware in order to truly unlock the potential for AI. Physics-based hardware, such as thermodynamic computing, has the potential to provide a fast, low-power means to accelerate AI primitives, especially generative AI and probabilistic AI. In this work, we present the first continuous-variable thermodynamic computer, which we call the stochastic processing unit (SPU). Our SPU is composed of RLC circuits, as unit cells, on a printed circuit board, with 8 unit cells that are all-to-all coupled via switched capacitances. It can be used for either sampling or linear algebra primitives, and we demonstrate Gaussian sampling and matrix inversion on our hardware. The latter represents the first thermodynamic linear algebra experiment. We also illustrate the applicability of the SPU to uncertainty quantification for neural network classification. We envision that this hardware, when scaled up in size, will have significant impact on accelerating various probabilistic AI applications.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 14 of its 45 references that are in the map. First posted on arXiv 8 Dec 2023.
Builds on
14 of 45 references.
References · 14
- 2020Simple and Principled Uncertainty Estimation with Deterministic Deep Learning via Distance Awarenesscited by 389
- 2014Stochastic Gradient Hamiltonian Monte Carlocited by 341
- 2021What Are Bayesian Neural Network Posteriors Really Like?cited by 307
- 2020The Hardware Lotterycited by 160
- 2022Zeus: Understanding and Optimizing GPU Energy Consumption of DNN Trainingcited by 78
- 2021Massively Parallel Probabilistic Computing with Sparse Ising Machinescited by 24
- 2023Thermodynamic AI and the fluctuation frontiercited by 15
- 2023A full-stack view of probabilistic computing with p-bits: devices, architectures and algorithmscited by 13
- 2019Thermodynamic Computingcited by 12
- 2019Thermodynamic Neural Networkcited by 9
- 2021High-quality Thermal Gibbs Sampling with Quantum Annealing Hardwarecited by 9
- 2023Analog Iterative Machine (AIM): using light to solve quadratic optimization problems with mixed variablescited by 6
2 more
Built on by
Citing papers per year: 2024: 4; 2025: 8; 2026: 4.
16 papers.
Sort:
By area:
- 2024Thermodynamic Natural Gradient Descentcited by 4
- 2024Nonlinear thermodynamic computing out of equilibriumcited by 4
- 2025Training thermodynamic computers by gradient descentcited by 4
- 2024Thermodynamic Bayesian Inferencecited by 2
- 2025Self-orthogonalizing attractor neural networks emerging from the free energy principlecited by 2
- 2025Local Learning Rules for Out-of-Equilibrium Physical Generative Modelscited by 2
- 2025The Conditions of Physical Embodiment Enable Generalization and Carecited by 1
- 2026Robust Stochastic Gradient Posterior Sampling with Lattice Based Discretisationcited by 1
- 2026A Blueprint for Equilibrium-Based Differentiable Continuous-Variable Thermodynamic Computingcited by 1
- 2024Provable Accuracy Bounds for Hybrid Dynamical Optimization and Samplingcited by 0
- 2025Thermodynamic cost of inference and learning in physical neural networkscited by 0
- 2025Agentic Information Theory: Ergodicity and Intrinsic Semantics of Information Processescited by 0
4 more
- 2025Thermodynamics-Inspired Computing with Oscillatory Neural Networks for Inverse Matrix Computationcited by 0
- 2025Learning with springs and stickscited by 0
- 2026CN101 - A Digital Thermodynamic Computer for Generative AIcited by 0
- 2026Online local learning for generative thermodynamic computingcited by 0
- 2026Online local learning for generative thermodynamic computing14 Sep 2026
- 2026CN101 - A Digital Thermodynamic Computer for Generative AI1 Aug 2026
- 2026A Blueprint for Equilibrium-Based Differentiable Continuous-Variable Thermodynamic Computing17 Jul 2026
- 2026Robust Stochastic Gradient Posterior Sampling with Lattice Based Discretisation17 Feb 2026
- 2025The Conditions of Physical Embodiment Enable Generalization and Care8 Oct 2025
- 2025Training thermodynamic computers by gradient descent18 Sep 2025
- 2025Learning with springs and sticks26 Aug 2025
- 2025Thermodynamics-Inspired Computing with Oscillatory Neural Networks for Inverse Matrix Computation30 Jul 2025
- 2025Local Learning Rules for Out-of-Equilibrium Physical Generative Models23 Jun 2025
- 2025Self-orthogonalizing attractor neural networks emerging from the free energy principle28 May 2025
- 2025Agentic Information Theory: Ergodicity and Intrinsic Semantics of Information Processes25 May 2025
- 2025Thermodynamic cost of inference and learning in physical neural networks13 Mar 2025
4 more
- 2024Nonlinear thermodynamic computing out of equilibrium22 Dec 2024
- 2024Provable Accuracy Bounds for Hybrid Dynamical Optimization and Sampling8 Oct 2024
- 2024Thermodynamic Bayesian Inference2 Oct 2024
- 2024Thermodynamic Natural Gradient Descent22 May 2024
- 2024Thermodynamic Natural Gradient Descentcited by 4
- 2024Nonlinear thermodynamic computing out of equilibriumcited by 4
- 2025Training thermodynamic computers by gradient descentcited by 4
- 2024Thermodynamic Bayesian Inferencecited by 2
- 2025Self-orthogonalizing attractor neural networks emerging from the free energy principlecited by 2
- 2025The Conditions of Physical Embodiment Enable Generalization and Carecited by 1
- 2026Robust Stochastic Gradient Posterior Sampling with Lattice Based Discretisationcited by 1
- 2026A Blueprint for Equilibrium-Based Differentiable Continuous-Variable Thermodynamic Computingcited by 1
- 2024Provable Accuracy Bounds for Hybrid Dynamical Optimization and Samplingcited by 0
- 2025Thermodynamic cost of inference and learning in physical neural networkscited by 0
- 2025Thermodynamics-Inspired Computing with Oscillatory Neural Networks for Inverse Matrix Computationcited by 0
- 2025Learning with springs and stickscited by 0
12 most cited of 14 All 14 (JSON)
- 2026Online local learning for generative thermodynamic computing14 Sep 2026
- 2026CN101 - A Digital Thermodynamic Computer for Generative AI1 Aug 2026
- 2026A Blueprint for Equilibrium-Based Differentiable Continuous-Variable Thermodynamic Computing17 Jul 2026
- 2026Robust Stochastic Gradient Posterior Sampling with Lattice Based Discretisation17 Feb 2026
- 2025The Conditions of Physical Embodiment Enable Generalization and Care8 Oct 2025
- 2025Training thermodynamic computers by gradient descent18 Sep 2025
- 2025Learning with springs and sticks26 Aug 2025
- 2025Thermodynamics-Inspired Computing with Oscillatory Neural Networks for Inverse Matrix Computation30 Jul 2025
- 2025Self-orthogonalizing attractor neural networks emerging from the free energy principle28 May 2025
- 2025Thermodynamic cost of inference and learning in physical neural networks13 Mar 2025
- 2024Nonlinear thermodynamic computing out of equilibrium22 Dec 2024
- 2024Provable Accuracy Bounds for Hybrid Dynamical Optimization and Sampling8 Oct 2024
12 newest of 14 All 14 (JSON)