Proof of the Contiguity Conjecture and Lognormal Limit for the Symmetric Perceptron
Not on the map. Why?
Abstract (arXiv)
We consider the symmetric binary perceptron model, a simple model of neural networks that has gathered significant attention in the statistical physics, information theory and probability theory communities, with recent connections made to the performance of learning algorithms in Baldassi et al. '15. We establish that the partition function of this model, normalized by its expected value, converges to a lognormal distribution. As a consequence, this allows us to establish several conjectures for this model: (i) it proves the contiguity conjecture of Aubin et al. '19 between the planted and unplanted models in the satisfiable regime; (ii) it establishes the sharp threshold conjecture; (iii) it proves the frozen 1-RSB conjecture in the symmetric case, conjectured first by Krauth-M'ezard '89 in the asymmetric case. In a recent work of Perkins-Xu '21, the last two conjectures were also established by proving that the partition function concentrates on an exponential scale, under an analytical assumption on a real-valued function. This left open the contiguity conjecture and the lognormal limit characterization, which are established here unconditionally, with the analytical assumption verified. In particular, our proof technique relies on a dense counter-part of the small graph conditioning method, which was developed for sparse models in the celebrated work of Robinson and Wormald.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 7 of its 35 references that are in the map. First posted on arXiv 25 Feb 2021.
Builds on
7 of 35 references.
References · 7
- 2016Unreasonable Effectiveness of Learning Neural Networks: From Accessible States and Robust Ensembles to Basic Algorithmic Schemescited by 40
- 2015Subdominant Dense Clusters Allow for Simple Learning and High Computational Performance in Neural Networks with Discrete Synapsescited by 39
- 2015Local entropy as a measure for sampling solutions in Constraint Satisfaction Problemscited by 20
- 2014Origin of the computational hardness for learning with binary synapsescited by 16
- 2013Discrete perceptronscited by 14
- 2019Clustering of solutions in the symmetric binary perceptroncited by 12
- 2013Entropy landscape of solutions in the binary perceptron problemcited by 10
Built on by
Citing papers per year: 2021: 3; 2022: 0; 2023: 5; 2024: 2; 2025: 5; 2026: 3.
18 papers.
Sort:
- 2021Learning through atypical "phase transitions" in overparameterized neural networkscited by 21
- 2021Binary perceptron: efficient algorithms can find solutions in a rare well-connected clustercited by 13
- 2023Typical and atypical solutions in non-convex neural networks with discrete and continuous weightscited by 13
- 2023Binary perceptrons capacity via fully lifted random duality theorycited by 13
- 2023Fl RDT based ultimate lowering of the negative spherical perceptron capacitycited by 11
- 2024Exact full-RSB SAT/UNSAT transition in infinitely wide two-layer neural networkscited by 6
- 2025Rare dense solutions clusters in asymmetric binary perceptrons -- local entropy via fully lifted RDTcited by 5
- 2025A CLuP algorithm to practically achieve ~ 0.76 SK--model ground state free energycited by 5
- 2023High-dimensional manifold of solutions in neural networks: insights from statistical physicscited by 4
- 2024Injectivity capacity of ReLU gatescited by 4
- 2025Binary perceptron computational gap -- a parametric fl RDT viewcited by 3
- 2021Equivalence between algorithmic instability and transition to replica symmetry breaking in perceptron learning systemscited by 1
6 more
- 2023Sharp analysis of EM for learning mixtures of pairwise differencescited by 1
- 2026Parametric RDT approach to computational gap of symmetric binary perceptroncited by 1
- 2026Statistically Undetectable Backdoors in Deep Neural Networkscited by 1
- 2025Phase transition of descending phase retrieval algorithmscited by 0
- 2025A large deviation view of stationarized fully lifted blirp interpolationcited by 0
- 2026Ultrametric OGP - parametric RDT symmetric binary perceptron connectioncited by 0
- 2026Statistically Undetectable Backdoors in Deep Neural Networks10 Jul 2026
- 2026Ultrametric OGP - parametric RDT symmetric binary perceptron connection21 Apr 2026
- 2026Parametric RDT approach to computational gap of symmetric binary perceptron15 Jan 2026
- 2025Binary perceptron computational gap -- a parametric fl RDT view2 Nov 2025
- 2025A CLuP algorithm to practically achieve ~ 0.76 SK--model ground state free energy12 Jul 2025
- 2025Rare dense solutions clusters in asymmetric binary perceptrons -- local entropy via fully lifted RDT24 Jun 2025
- 2025A large deviation view of stationarized fully lifted blirp interpolation24 Jun 2025
- 2025Phase transition of descending phase retrieval algorithms23 Jun 2025
- 2024Injectivity capacity of ReLU gates28 Oct 2024
- 2024Exact full-RSB SAT/UNSAT transition in infinitely wide two-layer neural networks9 Oct 2024
- 2023Fl RDT based ultimate lowering of the negative spherical perceptron capacity27 Dec 2023
- 2023Binary perceptrons capacity via fully lifted random duality theory29 Nov 2023
6 more
- 2023High-dimensional manifold of solutions in neural networks: insights from statistical physics17 Sep 2023
- 2023Typical and atypical solutions in non-convex neural networks with discrete and continuous weights26 Apr 2023
- 2023Sharp analysis of EM for learning mixtures of pairwise differences20 Feb 2023
- 2021Equivalence between algorithmic instability and transition to replica symmetry breaking in perceptron learning systems26 Nov 2021
- 2021Binary perceptron: efficient algorithms can find solutions in a rare well-connected cluster4 Nov 2021
- 2021Learning through atypical "phase transitions" in overparameterized neural networks1 Oct 2021
- 2021Learning through atypical "phase transitions" in overparameterized neural networkscited by 21
- 2021Binary perceptron: efficient algorithms can find solutions in a rare well-connected clustercited by 13
- 2023Typical and atypical solutions in non-convex neural networks with discrete and continuous weightscited by 13
- 2023Binary perceptrons capacity via fully lifted random duality theorycited by 13
- 2023Fl RDT based ultimate lowering of the negative spherical perceptron capacitycited by 11
- 2024Exact full-RSB SAT/UNSAT transition in infinitely wide two-layer neural networkscited by 6
- 2025Rare dense solutions clusters in asymmetric binary perceptrons -- local entropy via fully lifted RDTcited by 5
- 2025A CLuP algorithm to practically achieve ~ 0.76 SK--model ground state free energycited by 5
- 2023High-dimensional manifold of solutions in neural networks: insights from statistical physicscited by 4
- 2024Injectivity capacity of ReLU gatescited by 4
- 2025Binary perceptron computational gap -- a parametric fl RDT viewcited by 3
- 2021Equivalence between algorithmic instability and transition to replica symmetry breaking in perceptron learning systemscited by 1
12 most cited of 18 All 18 (JSON)
- 2026Statistically Undetectable Backdoors in Deep Neural Networks10 Jul 2026
- 2026Ultrametric OGP - parametric RDT symmetric binary perceptron connection21 Apr 2026
- 2026Parametric RDT approach to computational gap of symmetric binary perceptron15 Jan 2026
- 2025Binary perceptron computational gap -- a parametric fl RDT view2 Nov 2025
- 2025A CLuP algorithm to practically achieve ~ 0.76 SK--model ground state free energy12 Jul 2025
- 2025Rare dense solutions clusters in asymmetric binary perceptrons -- local entropy via fully lifted RDT24 Jun 2025
- 2025A large deviation view of stationarized fully lifted blirp interpolation24 Jun 2025
- 2025Phase transition of descending phase retrieval algorithms23 Jun 2025
- 2024Injectivity capacity of ReLU gates28 Oct 2024
- 2024Exact full-RSB SAT/UNSAT transition in infinitely wide two-layer neural networks9 Oct 2024
- 2023Fl RDT based ultimate lowering of the negative spherical perceptron capacity27 Dec 2023
- 2023Binary perceptrons capacity via fully lifted random duality theory29 Nov 2023
12 newest of 18 All 18 (JSON)