mlsanityData to 7 Oct 2026

A Blueprint for Equilibrium-Based Differentiable Continuous-Variable Thermodynamic Computing

arXiv 2607.16183 ↗First posted 17 Jul 2026cs.LG cs.ET physics.app-phcited by 1

Not on the map. Why?

Abstract (arXiv)

To help address the escalating energy and latency demands of machine-learning workloads, we introduce a blueprint for an energy-efficient and fast thermodynamic computing stack that leverages stochastic analog processes in physical hardware. In this work, we focus on energy-based thermodynamic computing where the stochastic process is well described by Langevin dynamics with tunable energy potentials. The implementation of such potentials in physical hardware enables us to generate and sample from basic parameterized energy-based models. We demonstrate how to construct and train popular classes of machine learning models based on these hardware-native energy-based models, using the framework of probabilistic graphical models. We analyze the runtime and energy consumption of different models in this thermodynamic paradigm based on theoretical considerations and numerical studies. As a preliminary experimental realization of such hardware, we present our stochastic analog superconducting circuits driven by thermal noise. Together, these results outline a path toward energy-efficient thermodynamic hardware for probabilistic machine learning.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 77 of its 229 references that are in the map. First posted on arXiv 17 Jul 2026.

Builds on

77 of 229 references.

References · 77

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2024The Llama 3 Herd of Modelscited by 14,192
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 2016Layer Normalizationcited by 5,579
  6. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  7. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  8. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  9. 2020On Layer Normalization in the Transformer Architecturecited by 906
  10. 2015Automatic differentiation in machine learning: a surveycited by 846
  11. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
  12. 2015Variational Dropout and the Local Reparameterization Trickcited by 489
38 more
  1. 2021How to Train Your Energy-Based Modelscited by 271
  2. 2017Variational Dropout Sparsifies Deep Neural Networkscited by 265
  3. 2022On Neural Differential Equationscited by 264
  4. 2017Noisy Networks for Explorationcited by 262
  5. 2016Equilibrium Propagation: Bridging the Gap Between Energy-Based Models and Backpropagationcited by 251
  6. 2017Concrete Dropoutcited by 227
  7. 2023SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked Prefillscited by 187
  8. 2023Power Hungry Processing: Watts Driving the Cost of AI Deployment?cited by 186
  9. 2020The Hardware Lotterycited by 160
  10. 2017Parameter Space Noise for Explorationcited by 158
  11. 2024LLM Inference Unveiled: Survey and Roofline Model Insightscited by 147
  12. 2021Equinox: neural networks in JAX via callable PyTrees and filtered transformationscited by 143
  13. 2017Underdamped Langevin MCMC: A non-asymptotic analysiscited by 131
  14. 2016Deep Structured Energy Based Models for Anomaly Detectioncited by 113
  15. 2022Transformer for Graphs: An Overview from Architecture Perspectivecited by 107
  16. 2017Convergence of Langevin MCMC in KL-divergencecited by 86
  17. 2020Training End-to-End Analog Neural Networks with Equilibrium Propagationcited by 57
  18. 2020Neural Enhanced Belief Propagation on Factor Graphscited by 55
  19. 2014Efficiently learning Ising models on arbitrary graphscited by 50
  20. 2020A mathematical model for automatic differentiation in machine learningcited by 44
  21. 2022A Langevin-like Sampler for Discrete Distributionscited by 42
  22. 2024Compositional Generative Modeling: A Single Model is Not All You Needcited by 41
  23. 2022A Review of Uncertainty for Deep Reinforcement Learningcited by 36
  24. 2023A survey of the Vision Transformers and their CNN-Transformer based Variantscited by 33
  25. 2023Training an Ising Machine with Equilibrium Propagationcited by 29
  26. 2021Self-learning Machines based on Hamiltonian Echo Backpropagationcited by 28
  27. 2022Automatic Differentiation of Programs with Discrete Randomnesscited by 28
  28. 2023Universality laws for Gaussian mixtures in generalized linear modelscited by 28
  29. 2016Optimal structure and parameter learning of Ising modelscited by 26
  30. 2021Massively Parallel Probabilistic Computing with Sparse Ising Machinescited by 24
  31. 2022Discrete Langevin Sampler via Wasserstein Gradient Flowcited by 23
  32. 2022AI and ML Accelerator Survey and Trendscited by 23
  33. 2023Training Deep Boltzmann Networks with Sparse Ising Machinescited by 23
  34. 2023Thermodynamic Computing System for AI Applicationscited by 16
  35. 2023Thermodynamic AI and the fluctuation frontiercited by 15
  36. 2023A full-stack view of probabilistic computing with p-bits: devices, architectures and algorithmscited by 13
  37. 2021A visual introduction to Gaussian Belief Propagationcited by 12
  38. 2018Unsupervised Learning of Syntactic Structure with Invertible Neural Projectionscited by 11

50 most cited of 77 All 77 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.