mlsanityData to 7 Oct 2026

Thermodynamic Computing System for AI Applications

arXiv 2312.04836 ↗First posted 8 Dec 2023cs.ET cond-mat.stat-mech cs.AIcited by 16

Not on the map. Why?

Abstract (arXiv)

Recent breakthroughs in artificial intelligence (AI) algorithms have highlighted the need for novel computing hardware in order to truly unlock the potential for AI. Physics-based hardware, such as thermodynamic computing, has the potential to provide a fast, low-power means to accelerate AI primitives, especially generative AI and probabilistic AI. In this work, we present the first continuous-variable thermodynamic computer, which we call the stochastic processing unit (SPU). Our SPU is composed of RLC circuits, as unit cells, on a printed circuit board, with 8 unit cells that are all-to-all coupled via switched capacitances. It can be used for either sampling or linear algebra primitives, and we demonstrate Gaussian sampling and matrix inversion on our hardware. The latter represents the first thermodynamic linear algebra experiment. We also illustrate the applicability of the SPU to uncertainty quantification for neural network classification. We envision that this hardware, when scaled up in size, will have significant impact on accelerating various probabilistic AI applications.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 14 of its 45 references that are in the map. First posted on arXiv 8 Dec 2023.

Builds on

14 of 45 references.

References · 14

  1. 2020Simple and Principled Uncertainty Estimation with Deterministic Deep Learning via Distance Awarenesscited by 389
  2. 2014Stochastic Gradient Hamiltonian Monte Carlocited by 341
  3. 2021What Are Bayesian Neural Network Posteriors Really Like?cited by 307
  4. 2020The Hardware Lotterycited by 160
  5. 2022Zeus: Understanding and Optimizing GPU Energy Consumption of DNN Trainingcited by 78
  6. 2021Massively Parallel Probabilistic Computing with Sparse Ising Machinescited by 24
  7. 2023Thermodynamic AI and the fluctuation frontiercited by 15
  8. 2023A full-stack view of probabilistic computing with p-bits: devices, architectures and algorithmscited by 13
  9. 2019Thermodynamic Computingcited by 12
  10. 2019Thermodynamic Neural Networkcited by 9
  11. 2021High-quality Thermal Gibbs Sampling with Quantum Annealing Hardwarecited by 9
  12. 2023Analog Iterative Machine (AIM): using light to solve quadratic optimization problems with mixed variablescited by 6
2 more
  1. 2023Thermodynamic Computing via Autonomous Quantum Thermal Machinescited by 5
  2. 2022Stochastic Neuromorphic Circuits for Solving MAXCUTcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 8; 2026: 4.

16 papers.

Sort:

By area: