Inverse statistical problems: from the inverse Ising problem to data science
Not on the map. Why?
Abstract (arXiv)
Inverse problems in statistical physics are motivated by the challenges of `big data' in different fields, in particular high-throughput experiments in biology. In inverse problems, the usual procedure of statistical physics needs to be reversed: Instead of calculating observables on the basis of model parameters, we seek to infer parameters of a model based on observations. In this review, we focus on the inverse Ising problem and closely related problems, namely how to infer the coupling strengths between spins given observed spin correlations, magnetisations, or other data. We review applications of the inverse Ising problem, including the reconstruction of neural connections, protein structure determination, and the inference of gene regulatory networks. For the inverse Ising problem in equilibrium, a number of controlled and uncontrolled approximate solutions have been developed in the statistical mechanics community. A particularly strong method, pseudolikelihood, stems from statistics. We also review the inverse Ising problem in the non-equilibrium case, where the model parameters must be reconstructed based on non-equilibrium statistics.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Feb 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 3; 2023: 6; 2024: 9; 2025: 7; 2026: 4.
36 papers.
Sort:
By area:
- 2023Mapping of attention mechanisms to a generalized Potts modelcited by 19
- 2023Explaining the effects of non-convergent sampling in the training of Energy-Based Modelscited by 11
- 2022Privacy-preserving machine learning with tensor networkscited by 8
- 2023The autoregressive neural network architecture of the Boltzmann distribution of pairwise interacting spins systemscited by 8
- 2023Inferring effective couplings with Restricted Boltzmann Machinescited by 8
- 2024Fast training and sampling of Restricted Boltzmann Machinescited by 8
- 2023Feature Programming for Multivariate Time Series Predictioncited by 7
- 2025Inferring Higher-Order Couplings with Neural Networkscited by 7
- 2022Quantifying Relevance in Learning and Inferencecited by 5
- 2024Network reconstruction via the minimum description length principlecited by 5
- 2025A theoretical framework for overfitting in energy-based modelingcited by 5
- 2021Ising Model Selection Using ℓ1-Regularized Linear Regression: A Statistical Mechanics Analysiscited by 4
24 more
- 2021Quantum Approximate Optimization Algorithm applied to the binary perceptroncited by 3
- 2024CoRMF: Criticality-Ordered Recurrent Mean Field Ising Solvercited by 3
- 2024Self-attention as an attractor network: transient memories without backpropagationcited by 3
- 2024Scalable network reconstruction in subquadratic timecited by 2
- 2024Discrete distributions are learnable from metastable samplescited by 2
- 2025Pseudo-likelihood produces associative memories able to generalize, even for asymmetric couplingscited by 2
- 2021On Model Selection Consistency of Lasso for High-Dimensional Ising Modelscited by 1
- 2021Optimal regularizations for data generation with probabilistic graphical modelscited by 1
- 2022Categorical Distributions of Maximum Entropy under Marginal Constraintscited by 1
- 2023Biases in Inverse Ising Estimates of Near-Critical Behaviourcited by 1
- 2024Entropy, concentration, and learning: a statistical mechanics primercited by 1
- 2025Uncertainty quantification and posterior sampling for network reconstructioncited by 1
- 2025Inferring entropy production in many-body systems using nonequilibrium maximum entropycited by 1
- 2025Correspondence Between Ising Machines and Neural Networkscited by 1
- 2026STAR-Teaming: A Strategy-Response Multiplex Network Approach to Automated LLM Red Teamingcited by 1
- 2021Inference of stochastic time series with missing datacited by 0
- 2021Nonequilibrium thermodynamics of self-supervised learningcited by 0
- 2021Data-Driven Interaction Analysis of Line Failure Cascading in Power Grid Networkscited by 0
- 2024Solving Boltzmann Optimization Problems with Deep Learningcited by 0
- 2024Machine learning and optimization-based approaches to duality in statistical physicscited by 0
- 2025Data augmentation using diffusion models to enhance inverse Ising inferencecited by 0
- 2026Computationally sufficient statistics for Ising modelscited by 0
- 2026Scaling Up Thermodynamic AI Modelscited by 0
- 2026Cardinality-Stratified Interaction Decomposition for Interpretable Pairwise and Higher-Order Structure in Transactional Basket Datacited by 0
- 2026Cardinality-Stratified Interaction Decomposition for Interpretable Pairwise and Higher-Order Structure in Transactional Basket Data28 Sep 2026
- 2026Scaling Up Thermodynamic AI Models30 Jun 2026
- 2026STAR-Teaming: A Strategy-Response Multiplex Network Approach to Automated LLM Red Teaming21 Apr 2026
- 2026Computationally sufficient statistics for Ising models12 Feb 2026
- 2025Correspondence Between Ising Machines and Neural Networks2 Nov 2025
- 2025Pseudo-likelihood produces associative memories able to generalize, even for asymmetric couplings7 Jul 2025
- 2025Inferring entropy production in many-body systems using nonequilibrium maximum entropy15 May 2025
- 2025Data augmentation using diffusion models to enhance inverse Ising inference13 Mar 2025
- 2025Uncertainty quantification and posterior sampling for network reconstruction10 Mar 2025
- 2025A theoretical framework for overfitting in energy-based modeling31 Jan 2025
- 2025Inferring Higher-Order Couplings with Neural Networks10 Jan 2025
- 2024Machine learning and optimization-based approaches to duality in statistical physics7 Nov 2024
24 more
- 2024Discrete distributions are learnable from metastable samples17 Oct 2024
- 2024Entropy, concentration, and learning: a statistical mechanics primer27 Sep 2024
- 2024Self-attention as an attractor network: transient memories without backpropagation24 Sep 2024
- 2024Fast training and sampling of Restricted Boltzmann Machines24 May 2024
- 2024Network reconstruction via the minimum description length principle2 May 2024
- 2024CoRMF: Criticality-Ordered Recurrent Mean Field Ising Solver5 Mar 2024
- 2024Solving Boltzmann Optimization Problems with Deep Learning30 Jan 2024
- 2024Scalable network reconstruction in subquadratic time2 Jan 2024
- 2023Inferring effective couplings with Restricted Boltzmann Machines5 Sep 2023
- 2023Feature Programming for Multivariate Time Series Prediction9 Jun 2023
- 2023Mapping of attention mechanisms to a generalized Potts model14 Apr 2023
- 2023The autoregressive neural network architecture of the Boltzmann distribution of pairwise interacting spins systems16 Feb 2023
- 2023Explaining the effects of non-convergent sampling in the training of Energy-Based Models23 Jan 2023
- 2023Biases in Inverse Ising Estimates of Near-Critical Behaviour13 Jan 2023
- 2022Categorical Distributions of Maximum Entropy under Marginal Constraints7 Apr 2022
- 2022Privacy-preserving machine learning with tensor networks24 Feb 2022
- 2022Quantifying Relevance in Learning and Inference1 Feb 2022
- 2021Quantum Approximate Optimization Algorithm applied to the binary perceptron19 Dec 2021
- 2021Optimal regularizations for data generation with probabilistic graphical models2 Dec 2021
- 2021Data-Driven Interaction Analysis of Line Failure Cascading in Power Grid Networks2 Dec 2021
- 2021On Model Selection Consistency of Lasso for High-Dimensional Ising Models16 Oct 2021
- 2021Nonequilibrium thermodynamics of self-supervised learning16 Jun 2021
- 2021Ising Model Selection Using ℓ1-Regularized Linear Regression: A Statistical Mechanics Analysis8 Feb 2021
- 2021Inference of stochastic time series with missing data28 Jan 2021
- 2023Mapping of attention mechanisms to a generalized Potts modelcited by 19
- 2023Explaining the effects of non-convergent sampling in the training of Energy-Based Modelscited by 11
- 2022Privacy-preserving machine learning with tensor networkscited by 8
- 2023The autoregressive neural network architecture of the Boltzmann distribution of pairwise interacting spins systemscited by 8
- 2023Inferring effective couplings with Restricted Boltzmann Machinescited by 8
- 2024Fast training and sampling of Restricted Boltzmann Machinescited by 8
- 2023Feature Programming for Multivariate Time Series Predictioncited by 7
- 2025Inferring Higher-Order Couplings with Neural Networkscited by 7
- 2022Quantifying Relevance in Learning and Inferencecited by 5
- 2024Network reconstruction via the minimum description length principlecited by 5
- 2025A theoretical framework for overfitting in energy-based modelingcited by 5
- 2021Ising Model Selection Using ℓ1-Regularized Linear Regression: A Statistical Mechanics Analysiscited by 4
12 most cited of 34 All 34 (JSON)
- 2026Cardinality-Stratified Interaction Decomposition for Interpretable Pairwise and Higher-Order Structure in Transactional Basket Data28 Sep 2026
- 2026Scaling Up Thermodynamic AI Models30 Jun 2026
- 2026Computationally sufficient statistics for Ising models12 Feb 2026
- 2025Correspondence Between Ising Machines and Neural Networks2 Nov 2025
- 2025Pseudo-likelihood produces associative memories able to generalize, even for asymmetric couplings7 Jul 2025
- 2025Inferring entropy production in many-body systems using nonequilibrium maximum entropy15 May 2025
- 2025Uncertainty quantification and posterior sampling for network reconstruction10 Mar 2025
- 2025A theoretical framework for overfitting in energy-based modeling31 Jan 2025
- 2025Inferring Higher-Order Couplings with Neural Networks10 Jan 2025
- 2024Machine learning and optimization-based approaches to duality in statistical physics7 Nov 2024
- 2024Discrete distributions are learnable from metastable samples17 Oct 2024
- 2024Entropy, concentration, and learning: a statistical mechanics primer27 Sep 2024
12 newest of 34 All 34 (JSON)