mlsanityData to 14 Oct 2026

Fully lifted random duality theory

arXiv 2312.00070 ↗First posted 29 Nov 2023math.PR cs.IT math.ITcited by 18

Not on the map. Why?

Abstract (arXiv)

We study a generic class of random optimization problems (rops) and their typical behavior. The foundational aspects of the random duality theory (RDT), associated with rops, were discussed in citeStojnicRegRndDlt10, where it was shown that one can often infer rops' behavior even without actually solving them. Moreover, citeStojnicRegRndDlt10 uncovered that various quantities relevant to rops (including, for example, their typical objective values) can be determined (in a large dimensional context) even completely analytically. The key observation was that the strong deterministic duality implies the, so-called, strong random duality and therefore the full exactness of the analytical RDT characterizations. Here, we attack precisely those scenarios where the strong deterministic duality is not necessarily present and connect them to the recent progress made in studying bilinearly indexed (bli) random processes in citeStojnicnflgscompyx23,Stojnicsflgscompyx23. In particular, utilizing a fully lifted (fl) interpolating comparison mechanism introduced in citeStojnicnflgscompyx23, we establish corresponding fully lifted RDT (fl RDT). We then rely on a stationarized fl interpolation realization introduced in citeStojnicsflgscompyx23 to obtain complete statitionarized fl RDT (sfl RDT). A few well known problems are then discussed as illustrations of a wide range of practical applications implied by the generality of the considered rops.

Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 Nov 2023.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 3; 2024: 5; 2025: 7; 2026: 3.

18 papers.

Sort:

  1. 2023Fl RDT based ultimate lowering of the negative spherical perceptron capacitycited by 11
  2. 2025Rare dense solutions clusters in asymmetric binary perceptrons -- local entropy via fully lifted RDTcited by 5
  3. 2025A CLuP algorithm to practically achieve ~ 0.76 SK--model ground state free energycited by 5
  4. 2024Fixed width treelike neural networks capacity analysis -- generic activationscited by 4
  5. 2024Injectivity capacity of ReLU gatescited by 4
  6. 2026High-Dimensional Statistics: Reflections on Progress and Open Problemscited by 4
  7. 2023Capacity of the treelike sign perceptrons neural networks with one hidden layer -- RDT based upper boundscited by 3
  8. 2023Lifted RDT based capacity analysis of the 1-hidden layer treelike sign perceptrons neural networkscited by 3
  9. 2024Deep ReLU networks -- injectivity capacity upper boundscited by 3
  10. 2025CLuP practically achieves ~ 1.77 positive and ~ 0.33 negative Hopfield model ground state free energycited by 3
  11. 2025Binary perceptron computational gap -- a parametric fl RDT viewcited by 3
  12. 2024Capacity of the Hebbian-Hopfield network associative memorycited by 1
6 more
  1. 2026Parametric RDT approach to computational gap of symmetric binary perceptroncited by 1
  2. 2024Theoretical limits of descending ℓ0 sparse-regression ML algorithmscited by 0
  3. 2025Phase transition of descending phase retrieval algorithmscited by 0
  4. 2025Optimal spectral initializers impact on phase retrieval phase transitions -- an RDT viewcited by 0
  5. 2025Phase retrieval with rank d measurements -- descending algorithms phase transitionscited by 0
  6. 2026Ultrametric OGP - parametric RDT symmetric binary perceptron connectioncited by 0