Binary perceptrons capacity via fully lifted random duality theory
Not on the map. Why?
Abstract (arXiv)
We study the statistical capacity of the classical binary perceptrons with general thresholds kappa. After recognizing the connection between the capacity and the bilinearly indexed (bli) random processes, we utilize a recent progress in studying such processes to characterize the capacity. In particular, we rely on fully lifted random duality theory (fl RDT) established in citeStojnicflrdt23 to create a general framework for studying the perceptrons' capacities. Successful underlying numerical evaluations are required for the framework (and ultimately the entire fl RDT machinery) to become fully practically operational. We present results obtained in that directions and uncover that the capacity characterizations are achieved on the second (first non-trivial) level of stationarized full lifting. The obtained results exactly match the replica symmetry breaking predictions obtained through statistical physics replica methods in citeKraMez89. Most notably, for the famous zero-threshold scenario, kappa=0, we uncover the well known α≈0.8330786 scaled capacity.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 12 of its 53 references that are in the map. First posted on arXiv 29 Nov 2023.
Builds on
12 of 53 references.
References · 12
- 2013Regularly random dualitycited by 24
- 2013Another look at the Gardner problemcited by 24
- 2020Discrepancy Minimization via a Self-Balancing Walkcited by 22
- 2021Proof of the Contiguity Conjecture and Lognormal Limit for the Symmetric Perceptroncited by 18
- 2013Discrete perceptronscited by 14
- 2013Lifting ℓ1-optimization strong and sectional thresholdscited by 13
- 2013Lifting/lowering Hopfield models ground state energiescited by 13
- 2020Algorithmic pure states for the negative spherical perceptroncited by 13
- 2021Binary perceptron: efficient algorithms can find solutions in a rare well-connected clustercited by 13
- 2022Algorithms and Barriers in the Symmetric Binary Perceptron Modelcited by 12
- 2013Spherical perceptron as a storage memory with limited errorscited by 11
- 2016Box constrained ℓ1 optimization in random linear systems -- asymptoticscited by 3
Built on by
Citing papers per year: 2023: 2; 2024: 4; 2025: 5; 2026: 2.
13 papers.
Sort:
- 2023Fl RDT based ultimate lowering of the negative spherical perceptron capacitycited by 11
- 2025Rare dense solutions clusters in asymmetric binary perceptrons -- local entropy via fully lifted RDTcited by 5
- 2025A CLuP algorithm to practically achieve ~ 0.76 SK--model ground state free energycited by 5
- 2024Injectivity capacity of ReLU gatescited by 4
- 2023Capacity of the treelike sign perceptrons neural networks with one hidden layer -- RDT based upper boundscited by 3
- 2024Deep ReLU networks -- injectivity capacity upper boundscited by 3
- 2025CLuP practically achieves ~ 1.77 positive and ~ 0.33 negative Hopfield model ground state free energycited by 3
- 2025Binary perceptron computational gap -- a parametric fl RDT viewcited by 3
- 2024Capacity of the Hebbian-Hopfield network associative memorycited by 1
- 2026Parametric RDT approach to computational gap of symmetric binary perceptroncited by 1
- 2024Exact objectives of random linear programs and mean widths of random polyhedronscited by 0
- 2025A large deviation view of stationarized fully lifted blirp interpolationcited by 0
1 more
- 2026Ultrametric OGP - parametric RDT symmetric binary perceptron connection21 Apr 2026
- 2026Parametric RDT approach to computational gap of symmetric binary perceptron15 Jan 2026
- 2025Binary perceptron computational gap -- a parametric fl RDT view2 Nov 2025
- 2025CLuP practically achieves ~ 1.77 positive and ~ 0.33 negative Hopfield model ground state free energy30 Jul 2025
- 2025A CLuP algorithm to practically achieve ~ 0.76 SK--model ground state free energy12 Jul 2025
- 2025Rare dense solutions clusters in asymmetric binary perceptrons -- local entropy via fully lifted RDT24 Jun 2025
- 2025A large deviation view of stationarized fully lifted blirp interpolation24 Jun 2025
- 2024Deep ReLU networks -- injectivity capacity upper bounds27 Dec 2024
- 2024Injectivity capacity of ReLU gates28 Oct 2024
- 2024Exact objectives of random linear programs and mean widths of random polyhedrons6 Mar 2024
- 2024Capacity of the Hebbian-Hopfield network associative memory4 Mar 2024
- 2023Fl RDT based ultimate lowering of the negative spherical perceptron capacity27 Dec 2023
- 2023Fl RDT based ultimate lowering of the negative spherical perceptron capacitycited by 11
- 2025Rare dense solutions clusters in asymmetric binary perceptrons -- local entropy via fully lifted RDTcited by 5
- 2025A CLuP algorithm to practically achieve ~ 0.76 SK--model ground state free energycited by 5
- 2024Injectivity capacity of ReLU gatescited by 4
- 2023Capacity of the treelike sign perceptrons neural networks with one hidden layer -- RDT based upper boundscited by 3
- 2024Deep ReLU networks -- injectivity capacity upper boundscited by 3
- 2025CLuP practically achieves ~ 1.77 positive and ~ 0.33 negative Hopfield model ground state free energycited by 3
- 2025Binary perceptron computational gap -- a parametric fl RDT viewcited by 3
- 2024Capacity of the Hebbian-Hopfield network associative memorycited by 1
- 2026Parametric RDT approach to computational gap of symmetric binary perceptroncited by 1
- 2024Exact objectives of random linear programs and mean widths of random polyhedronscited by 0
- 2025A large deviation view of stationarized fully lifted blirp interpolationcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Ultrametric OGP - parametric RDT symmetric binary perceptron connection21 Apr 2026
- 2026Parametric RDT approach to computational gap of symmetric binary perceptron15 Jan 2026
- 2025Binary perceptron computational gap -- a parametric fl RDT view2 Nov 2025
- 2025CLuP practically achieves ~ 1.77 positive and ~ 0.33 negative Hopfield model ground state free energy30 Jul 2025
- 2025A CLuP algorithm to practically achieve ~ 0.76 SK--model ground state free energy12 Jul 2025
- 2025Rare dense solutions clusters in asymmetric binary perceptrons -- local entropy via fully lifted RDT24 Jun 2025
- 2025A large deviation view of stationarized fully lifted blirp interpolation24 Jun 2025
- 2024Deep ReLU networks -- injectivity capacity upper bounds27 Dec 2024
- 2024Injectivity capacity of ReLU gates28 Oct 2024
- 2024Exact objectives of random linear programs and mean widths of random polyhedrons6 Mar 2024
- 2024Capacity of the Hebbian-Hopfield network associative memory4 Mar 2024
- 2023Fl RDT based ultimate lowering of the negative spherical perceptron capacity27 Dec 2023
12 newest of 13 All 13 (JSON)