{"total":115,"rows":[{"id":"2206.14486","title":"Beyond neural scaling laws: beating power law scaling via data pruning","created":"2022-06-29","cited_by_count":528,"area":null},{"id":"2307.02129","title":"How Deep Neural Networks Learn Compositional Data: The Random Hierarchy Model","created":"2023-07-05","cited_by_count":71,"area":null},{"id":"2106.03791","title":"Learning Gaussian Mixtures with Generalised Linear Models: Precise Asymptotics in High-dimensions","created":"2021-06-07","cited_by_count":54,"area":null},{"id":"2106.11438","title":"Instance-Optimal Compressed Sensing via Posterior Sampling","created":"2021-06-21","cited_by_count":43,"area":null},{"id":"2302.00375","title":"Bayes-optimal Learning of Deep Random Networks of Extensive-width","created":"2023-02-01","cited_by_count":41,"area":null},{"id":"2207.06569","title":"Benign, Tempered, or Catastrophic: A Taxonomy of Overfitting","created":"2022-07-14","cited_by_count":36,"area":null},{"id":"2109.11905","title":"Graph-based Approximate Message Passing Iterations","created":"2021-09-24","cited_by_count":35,"area":null},{"id":"2205.09727","title":"The Franz-Parisi Criterion and Computational Trade-offs in High Dimensional Statistics","created":"2022-05-19","cited_by_count":31,"area":null},{"id":"2402.03902","title":"A phase transition between positional and semantic learning in a solvable model of dot-product attention","created":"2024-02-06","cited_by_count":30,"area":null},{"id":"2604.21691","title":"There Will Be a Scientific Theory of Deep Learning","created":"2026-04-23","cited_by_count":29,"area":null},{"id":"2308.14085","title":"Sampling with flows, diffusion and autoregressive neural networks: A spin-glass perspective","created":"2023-08-27","cited_by_count":26,"area":null},{"id":"2408.03733","title":"Bayes-optimal learning of an extensive-width neural network from quadratically many samples","created":"2024-08-07","cited_by_count":23,"area":null},{"id":"2109.00454","title":"The emergence of a concept in shallow neural networks","created":"2021-09-01","cited_by_count":20,"area":null},{"id":"2106.00734","title":"Post-mortem on a deep learning contest: a Simpson's paradox and the complementary roles of scale metrics versus shape metrics","created":"2021-06-01","cited_by_count":19,"area":null},{"id":"2201.13383","title":"Fluctuations, Bias, Variance & Ensemble of Learners: Exact Asymptotics for Convex Losses in High-Dimension","created":"2022-01-31","cited_by_count":19,"area":null},{"id":"2305.11041","title":"High-dimensional Asymptotics of Denoising Autoencoders","created":"2023-05-18","cited_by_count":19,"area":null},{"id":"2405.15480","title":"Fundamental computational limits of weak learnability in high-dimensional multi-index models","created":"2024-05-24","cited_by_count":19,"area":null},{"id":"2405.20236","title":"Disentangling and Mitigating the Impact of Task Similarity for Continual Learning","created":"2024-05-30","cited_by_count":19,"area":null},{"id":"2202.03295","title":"Theoretical characterization of uncertainty in high-dimensional linear classification","created":"2022-02-07","cited_by_count":18,"area":null},{"id":"2102.09449","title":"Quantum field-theoretic machine learning","created":"2021-02-18","cited_by_count":16,"area":null},{"id":"2210.12760","title":"On double-descent in uncertainty quantification in overparametrized models","created":"2022-10-23","cited_by_count":16,"area":null},{"id":"2502.03350","title":"Optimal Task Order for Continual Learning of Multiple Tasks","created":"2025-02-05","cited_by_count":14,"area":null},{"id":"2502.20003","title":"Asymptotics of Non-Convex Generalized Linear Models in High-Dimensions: A proof of the replica formula","created":"2025-02-27","cited_by_count":14,"area":null},{"id":"2211.06617","title":"Empirical Risk Minimization with Relative Entropy Regularization","created":"2022-11-12","cited_by_count":13,"area":null},{"id":"2302.05440","title":"Forward Learning with Top-Down Feedback: Empirical and Analytical Characterization","created":"2023-02-10","cited_by_count":13,"area":null},{"id":"2110.14583","title":"Deep learning via message passing algorithms based on belief propagation","created":"2021-10-27","cited_by_count":12,"area":null},{"id":"2204.02704","title":"Fundamental limits to learning closed-form mathematical models from data","created":"2022-04-06","cited_by_count":12,"area":null},{"id":"2409.13904","title":"High-dimensional learning of narrow neural networks","created":"2024-09-20","cited_by_count":12,"area":null},{"id":"2303.02644","title":"Expectation consistency for calibration of neural networks","created":"2023-03-05","cited_by_count":10,"area":null},{"id":"2306.12380","title":"On the Validation of Gibbs Algorithms: Training Datasets, Test Datasets and their Aggregation","created":"2023-06-21","cited_by_count":10,"area":null},{"id":"2205.15935","title":"Bias-inducing geometries: an exactly solvable data model with fairness implications","created":"2022-05-31","cited_by_count":9,"area":null},{"id":"2305.06435","title":"Phase transitions in the mini-batch size for sparse and dense two-layer neural networks","created":"2023-05-10","cited_by_count":9,"area":null},{"id":"2306.14975","title":"The Underlying Scaling Laws and Universal Statistical Structure of Complex Datasets","created":"2023-06-26","cited_by_count":9,"area":null},{"id":"2106.11950","title":"Fundamental limits for rank-one matrix estimation with groupwise heteroskedasticity","created":"2021-06-22","cited_by_count":8,"area":null},{"id":"2201.08082","title":"Kernel Methods and Multi-layer Perceptrons Learn Linear Models in High Dimensions","created":"2022-01-20","cited_by_count":8,"area":null},{"id":"2202.04385","title":"Empirical Risk Minimization with Relative Entropy Regularization: Optimality and Sensitivity Analysis","created":"2022-02-09","cited_by_count":8,"area":null},{"id":"2302.06665","title":"Optimal Algorithms for the Inhomogeneous Spiked Wigner Model","created":"2023-02-13","cited_by_count":8,"area":null},{"id":"2302.08347","title":"The autoregressive neural network architecture of the Boltzmann distribution of pairwise interacting spins systems","created":"2023-02-16","cited_by_count":8,"area":null},{"id":"2602.10680","title":"A solvable high-dimensional model where nonlinear autoencoders learn structure invisible to PCA while test loss misaligns with generalization","created":"2026-02-11","cited_by_count":8,"area":null},{"id":"2102.06740","title":"Appearance of Random Matrix Theory in Deep Learning","created":"2021-02-12","cited_by_count":7,"area":null},{"id":"2303.02118","title":"Statistical-Computational Tradeoffs in Mixed Sparse Linear Regression","created":"2023-03-03","cited_by_count":7,"area":null},{"id":"2311.08340","title":"Causal Message Passing for Experiments with Unknown and General Network Interference","created":"2023-11-14","cited_by_count":7,"area":null},{"id":"2402.05674","title":"A High Dimensional Statistical Model for Adversarial Training: Geometry and Trade-Offs","created":"2024-02-08","cited_by_count":7,"area":null},{"id":"2403.02418","title":"The Role of the Time-Dependent Hessian in High-Dimensional Optimization","created":"2024-03-04","cited_by_count":7,"area":null},{"id":"2103.03561","title":"Nishimori meets Bethe: a spectral method for node classification in sparse weighted graphs","created":"2021-03-05","cited_by_count":6,"area":null},{"id":"2209.02001","title":"On free energy barriers in Gaussian priors and failure of cold start MCMC for high-dimensional unimodal distributions","created":"2022-09-05","cited_by_count":6,"area":null},{"id":"2202.00339","title":"Quantifying Relevance in Learning and Inference","created":"2022-02-01","cited_by_count":5,"area":null},{"id":"2205.10198","title":"A New Central Limit Theorem for the Augmented IPW Estimator: Variance Inflation, Cross-Fit Covariance and Beyond","created":"2022-05-20","cited_by_count":5,"area":null},{"id":"2302.13093","title":"Average case analysis of Lasso under ultra-sparse conditions","created":"2023-02-25","cited_by_count":5,"area":null},{"id":"2403.01723","title":"Statistical Mechanics of Dynamical System Identification","created":"2024-03-04","cited_by_count":5,"area":null},{"id":"2411.12030","title":"The Method of Gaps: Exact Expressions for the Generalization Error of Supervised Learning Algorithms","created":"2024-11-18","cited_by_count":5,"area":null},{"id":"2202.04509","title":"Optimal learning rate schedules in high-dimensional non-convex optimization problems","created":"2022-02-09","cited_by_count":4,"area":null},{"id":"2303.09995","title":"Neural-prior stochastic block model","created":"2023-03-17","cited_by_count":4,"area":null},{"id":"2403.03695","title":"Spectral Phase Transition and Optimal PCA in Block-Structured Spiked models","created":"2024-03-06","cited_by_count":4,"area":null},{"id":"2407.03522","title":"Optimal thresholds and algorithms for a model of multi-modal learning in high dimensions","created":"2024-07-03","cited_by_count":4,"area":null},{"id":"2411.01974","title":"On the phase diagram of extensive-rank symmetric matrix denoising beyond rotational invariance","created":"2024-11-04","cited_by_count":4,"area":null},{"id":"2505.11139","title":"Covariance Density Neural Networks","created":"2025-05-16","cited_by_count":4,"area":null},{"id":"2112.00183","title":"Descriptive vs. inferential community detection in networks: pitfalls, myths, and half-truths","created":"2021-11-30","cited_by_count":3,"area":null},{"id":"2211.02778","title":"Near-optimal multiple testing in Bayesian linear models with finite-sample FDR control","created":"2022-11-04","cited_by_count":3,"area":null},{"id":"2312.14922","title":"Learning from higher-order statistics, efficiently: hypothesis tests, random features, and neural networks","created":"2023-12-22","cited_by_count":3,"area":null},{"id":"2401.17269","title":"Effect of Weight Quantization on Learning Models by Typical Case Analysis","created":"2024-01-30","cited_by_count":3,"area":null},{"id":"2402.03169","title":"A Random Matrix Approach to Low-Multilinear-Rank Tensor Approximation","created":"2024-02-05","cited_by_count":3,"area":null},{"id":"2404.03272","title":"Cryptographic Hardness of Score Estimation","created":"2024-04-04","cited_by_count":3,"area":null},{"id":"2404.13404","title":"Solution space and storage capacity of fully connected two-layer neural networks with generic activation functions","created":"2024-04-20","cited_by_count":3,"area":null},{"id":"2406.16988","title":"MD tree: a model-diagnostic tree grown on loss landscape","created":"2024-06-24","cited_by_count":3,"area":null},{"id":"2408.15418","title":"Understanding GNNs for Boolean Satisfiability through Approximation Algorithms","created":"2024-08-27","cited_by_count":3,"area":null},{"id":"2410.18858","title":"Bilinear Sequence Regression: A Model for Learning from Long Sequences of High-dimensional Tokens","created":"2024-10-24","cited_by_count":3,"area":null},{"id":"2502.09832","title":"Computational Lower Bounds for Correlated Random Graphs via Algorithmic Contiguity","created":"2025-02-14","cited_by_count":3,"area":null},{"id":"2504.18072","title":"A Model Zoo on Phase Transitions in Neural Networks","created":"2025-04-25","cited_by_count":3,"area":null},{"id":"2506.01582","title":"Bayes optimal learning of attention-indexed models","created":"2025-06-02","cited_by_count":3,"area":null},{"id":"2105.07416","title":"Bayesian reconstruction of memories stored in neural networks from their connectivity","created":"2021-05-16","cited_by_count":2,"area":null},{"id":"2110.01901","title":"Inferring Hidden Structures in Random Graphs","created":"2021-10-05","cited_by_count":2,"area":null},{"id":"2112.09420","title":"A random energy approach to deep learning","created":"2021-12-17","cited_by_count":2,"area":null},{"id":"2302.03658","title":"Planted Bipartite Graph Detection","created":"2023-02-07","cited_by_count":2,"area":null},{"id":"2403.04234","title":"Fundamental limits of Non-Linear Low-Rank Matrix Estimation","created":"2024-03-07","cited_by_count":2,"area":null},{"id":"2410.16493","title":"Building Conformal Prediction Intervals with Approximate Message Passing","created":"2024-10-21","cited_by_count":2,"area":null},{"id":"2502.15131","title":"Optimal and Provable Calibration in High-Dimensional Binary Classification: Angular Calibration and Platt Scaling","created":"2025-02-21","cited_by_count":2,"area":null},{"id":"2503.06181","title":"Make Haste Slowly: A Theory of Emergent Structured Mixed Selectivity in Feature Learning ReLU Networks","created":"2025-03-08","cited_by_count":2,"area":null},{"id":"2506.06259","title":"An Optimized Franz-Parisi Criterion and its Equivalence with SQ Lower Bounds","created":"2025-06-06","cited_by_count":2,"area":null},{"id":"2510.01930","title":"Precise Dynamics of Diagonal Linear Networks: A Unifying Analysis by Dynamical Mean-Field Theory","created":"2025-10-02","cited_by_count":2,"area":null},{"id":"2603.17896","title":"A Noise Sensitivity Exponent Controls Large Statistical-to-Computational Gaps in Single- and Multi-Index Models","created":"2026-03-18","cited_by_count":2,"area":null},{"id":"2111.13302","title":"Equivalence between algorithmic instability and transition to replica symmetry breaking in perceptron learning systems","created":"2021-11-26","cited_by_count":1,"area":null},{"id":"2209.05464","title":"Understanding the Behavior of Belief Propagation","created":"2022-09-05","cited_by_count":1,"area":null},{"id":"2307.13535","title":"Do algorithms and barriers for sparse principal component analysis extend to other structured settings?","created":"2023-07-25","cited_by_count":1,"area":null},{"id":"2501.01963","title":"Statistical learning does not always entail knowledge","created":"2024-12-17","cited_by_count":1,"area":null},{"id":"2502.16292","title":"Generative diffusion for perceptron problems: statistical physics analysis and efficient algorithms","created":"2025-02-22","cited_by_count":1,"area":null},{"id":"2504.11830","title":"Emergence of Computational Structure in a Neural Network Physics Simulator","created":"2025-04-16","cited_by_count":1,"area":null},{"id":"2508.07397","title":"A Spin Glass Characterization of Neural Networks","created":"2025-08-10","cited_by_count":1,"area":null},{"id":"2603.18254","title":"Computation-Utility-Privacy Tradeoffs in Bayesian Estimation","created":"2026-03-18","cited_by_count":1,"area":null},{"id":"2605.14059","title":"Finite-size scaling of hetero-associative retrieval in continuous-signal-driven Ising spin systems","created":"2026-05-13","cited_by_count":1,"area":null},{"id":"2605.29153","title":"Unveiling Multi-regime Patterns in SciML: Distinct Failure Modes and Regime-specific Optimization","created":"2026-05-27","cited_by_count":1,"area":null},{"id":"2101.09994","title":"On maximum-likelihood estimation in the all-or-nothing regime","created":"2021-01-25","cited_by_count":0,"area":null},{"id":"2105.07882","title":"Efficient and accurate group testing via Belief Propagation: an empirical study","created":"2021-05-13","cited_by_count":0,"area":null},{"id":"2201.09986","title":"Bayesian Inference with Nonlinear Generative Models: Comments on Secure Learning","created":"2022-01-19","cited_by_count":0,"area":null},{"id":"2202.12468","title":"A residual-based message passing algorithm for constraint satisfaction problems","created":"2022-02-25","cited_by_count":0,"area":null},{"id":"2203.09636","title":"A Density Evolution framework for Preferential Recovery of Covariance and Causal Graphs from Compressed Measurements","created":"2022-03-17","cited_by_count":0,"area":null},{"id":"2205.12125","title":"Inference of a Rumor's Source in the Independent Cascade Model","created":"2022-05-24","cited_by_count":0,"area":null},{"id":"2302.07419","title":"Spatially heterogeneous learning by a deep student machine","created":"2023-02-15","cited_by_count":0,"area":null},{"id":"2306.16097","title":"Sparse Representations, Inference and Learning","created":"2023-06-28","cited_by_count":0,"area":null},{"id":"2405.10957","title":"Statistical Mechanics and Artificial Neural Networks: Principles, Models, and Applications","created":"2024-04-05","cited_by_count":0,"area":null}],"next_cursor":"100"}