{"total":128,"rows":[{"id":"2206.14486","title":"Beyond neural scaling laws: beating power law scaling via data pruning","created":"2022-06-29","cited_by_count":528,"area":null},{"id":"2102.08127","title":"Learning curves of generic features maps for realistic datasets with a teacher-student model","created":"2021-02-16","cited_by_count":126,"area":"distill"},{"id":"2107.04384","title":"Continual Learning in the Teacher-Student Setup: Impact of Task Similarity","created":"2021-07-09","cited_by_count":88,"area":"distill"},{"id":"2307.02129","title":"How Deep Neural Networks Learn Compositional Data: The Random Hierarchy Model","created":"2023-07-05","cited_by_count":71,"area":null},{"id":"2106.03791","title":"Learning Gaussian Mixtures with Generalised Linear Models: Precise Asymptotics in High-dimensions","created":"2021-06-07","cited_by_count":54,"area":null},{"id":"2106.11438","title":"Instance-Optimal Compressed Sensing via Posterior Sampling","created":"2021-06-21","cited_by_count":43,"area":null},{"id":"2302.00375","title":"Bayes-optimal Learning of Deep Random Networks of Extensive-width","created":"2023-02-01","cited_by_count":41,"area":null},{"id":"2207.06569","title":"Benign, Tempered, or Catastrophic: A Taxonomy of Overfitting","created":"2022-07-14","cited_by_count":36,"area":null},{"id":"2109.11905","title":"Graph-based Approximate Message Passing Iterations","created":"2021-09-24","cited_by_count":35,"area":null},{"id":"2205.09727","title":"The Franz-Parisi Criterion and Computational Trade-offs in High Dimensional Statistics","created":"2022-05-19","cited_by_count":31,"area":null},{"id":"2402.03902","title":"A phase transition between positional and semantic learning in a solvable model of dot-product attention","created":"2024-02-06","cited_by_count":30,"area":null},{"id":"2604.21691","title":"There Will Be a Scientific Theory of Deep Learning","created":"2026-04-23","cited_by_count":29,"area":null},{"id":"2106.08068","title":"An Analytical Theory of Curriculum Learning in Teacher-Student Networks","created":"2021-06-15","cited_by_count":27,"area":"distill"},{"id":"2308.14085","title":"Sampling with flows, diffusion and autoregressive neural networks: A spin-glass perspective","created":"2023-08-27","cited_by_count":26,"area":null},{"id":"2408.03733","title":"Bayes-optimal learning of an extensive-width neural network from quadratically many samples","created":"2024-08-07","cited_by_count":23,"area":null},{"id":"2109.00454","title":"The emergence of a concept in shallow neural networks","created":"2021-09-01","cited_by_count":20,"area":null},{"id":"2106.00734","title":"Post-mortem on a deep learning contest: a Simpson's paradox and the complementary roles of scale metrics versus shape metrics","created":"2021-06-01","cited_by_count":19,"area":null},{"id":"2201.13383","title":"Fluctuations, Bias, Variance & Ensemble of Learners: Exact Asymptotics for Convex Losses in High-Dimension","created":"2022-01-31","cited_by_count":19,"area":null},{"id":"2305.11041","title":"High-dimensional Asymptotics of Denoising Autoencoders","created":"2023-05-18","cited_by_count":19,"area":null},{"id":"2405.15480","title":"Fundamental computational limits of weak learnability in high-dimensional multi-index models","created":"2024-05-24","cited_by_count":19,"area":null},{"id":"2405.20236","title":"Disentangling and Mitigating the Impact of Task Similarity for Continual Learning","created":"2024-05-30","cited_by_count":19,"area":null},{"id":"2202.03295","title":"Theoretical characterization of uncertainty in high-dimensional linear classification","created":"2022-02-07","cited_by_count":18,"area":null},{"id":"2203.12094","title":"Learning curves for the multi-class teacher-student perceptron","created":"2022-03-22","cited_by_count":17,"area":"distill"},{"id":"2102.09449","title":"Quantum field-theoretic machine learning","created":"2021-02-18","cited_by_count":16,"area":null},{"id":"2210.12760","title":"On double-descent in uncertainty quantification in overparametrized models","created":"2022-10-23","cited_by_count":16,"area":null},{"id":"2501.03937","title":"A solvable model of learning generative diffusion: theory and insights","created":"2025-01-07","cited_by_count":14,"area":"diffusion"},{"id":"2502.03350","title":"Optimal Task Order for Continual Learning of Multiple Tasks","created":"2025-02-05","cited_by_count":14,"area":null},{"id":"2502.20003","title":"Asymptotics of Non-Convex Generalized Linear Models in High-Dimensions: A proof of the replica formula","created":"2025-02-27","cited_by_count":14,"area":null},{"id":"2211.06617","title":"Empirical Risk Minimization with Relative Entropy Regularization","created":"2022-11-12","cited_by_count":13,"area":null},{"id":"2302.05440","title":"Forward Learning with Top-Down Feedback: Empirical and Analytical Characterization","created":"2023-02-10","cited_by_count":13,"area":null},{"id":"2110.14583","title":"Deep learning via message passing algorithms based on belief propagation","created":"2021-10-27","cited_by_count":12,"area":null},{"id":"2204.02704","title":"Fundamental limits to learning closed-form mathematical models from data","created":"2022-04-06","cited_by_count":12,"area":null},{"id":"2409.13904","title":"High-dimensional learning of narrow neural networks","created":"2024-09-20","cited_by_count":12,"area":null},{"id":"2303.02644","title":"Expectation consistency for calibration of neural networks","created":"2023-03-05","cited_by_count":10,"area":null},{"id":"2306.12380","title":"On the Validation of Gibbs Algorithms: Training Datasets, Test Datasets and their Aggregation","created":"2023-06-21","cited_by_count":10,"area":null},{"id":"2205.15935","title":"Bias-inducing geometries: an exactly solvable data model with fairness implications","created":"2022-05-31","cited_by_count":9,"area":null},{"id":"2305.06435","title":"Phase transitions in the mini-batch size for sparse and dense two-layer neural networks","created":"2023-05-10","cited_by_count":9,"area":null},{"id":"2306.14975","title":"The Underlying Scaling Laws and Universal Statistical Structure of Complex Datasets","created":"2023-06-26","cited_by_count":9,"area":null},{"id":"2106.11950","title":"Fundamental limits for rank-one matrix estimation with groupwise heteroskedasticity","created":"2021-06-22","cited_by_count":8,"area":null},{"id":"2201.08082","title":"Kernel Methods and Multi-layer Perceptrons Learn Linear Models in High Dimensions","created":"2022-01-20","cited_by_count":8,"area":null},{"id":"2202.04385","title":"Empirical Risk Minimization with Relative Entropy Regularization: Optimality and Sensitivity Analysis","created":"2022-02-09","cited_by_count":8,"area":null},{"id":"2302.06665","title":"Optimal Algorithms for the Inhomogeneous Spiked Wigner Model","created":"2023-02-13","cited_by_count":8,"area":null},{"id":"2302.08347","title":"The autoregressive neural network architecture of the Boltzmann distribution of pairwise interacting spins systems","created":"2023-02-16","cited_by_count":8,"area":null},{"id":"2602.10680","title":"A solvable high-dimensional model where nonlinear autoencoders learn structure invisible to PCA while test loss misaligns with generalization","created":"2026-02-11","cited_by_count":8,"area":null},{"id":"2102.06740","title":"Appearance of Random Matrix Theory in Deep Learning","created":"2021-02-12","cited_by_count":7,"area":null},{"id":"2303.02118","title":"Statistical-Computational Tradeoffs in Mixed Sparse Linear Regression","created":"2023-03-03","cited_by_count":7,"area":null},{"id":"2311.08340","title":"Causal Message Passing for Experiments with Unknown and General Network Interference","created":"2023-11-14","cited_by_count":7,"area":null},{"id":"2402.05674","title":"A High Dimensional Statistical Model for Adversarial Training: Geometry and Trade-Offs","created":"2024-02-08","cited_by_count":7,"area":null},{"id":"2403.02418","title":"The Role of the Time-Dependent Hessian in High-Dimensional Optimization","created":"2024-03-04","cited_by_count":7,"area":null},{"id":"2103.03561","title":"Nishimori meets Bethe: a spectral method for node classification in sparse weighted graphs","created":"2021-03-05","cited_by_count":6,"area":null},{"id":"2209.02001","title":"On free energy barriers in Gaussian priors and failure of cold start MCMC for high-dimensional unimodal distributions","created":"2022-09-05","cited_by_count":6,"area":null},{"id":"2202.00339","title":"Quantifying Relevance in Learning and Inference","created":"2022-02-01","cited_by_count":5,"area":null},{"id":"2205.10198","title":"A New Central Limit Theorem for the Augmented IPW Estimator: Variance Inflation, Cross-Fit Covariance and Beyond","created":"2022-05-20","cited_by_count":5,"area":null},{"id":"2302.13093","title":"Average case analysis of Lasso under ultra-sparse conditions","created":"2023-02-25","cited_by_count":5,"area":null},{"id":"2403.01723","title":"Statistical Mechanics of Dynamical System Identification","created":"2024-03-04","cited_by_count":5,"area":null},{"id":"2411.12030","title":"The Method of Gaps: Exact Expressions for the Generalization Error of Supervised Learning Algorithms","created":"2024-11-18","cited_by_count":5,"area":null},{"id":"2202.04509","title":"Optimal learning rate schedules in high-dimensional non-convex optimization problems","created":"2022-02-09","cited_by_count":4,"area":null},{"id":"2303.09995","title":"Neural-prior stochastic block model","created":"2023-03-17","cited_by_count":4,"area":null},{"id":"2401.04191","title":"Dense Hopfield Networks in the Teacher-Student Setting","created":"2024-01-08","cited_by_count":4,"area":"distill"},{"id":"2403.03695","title":"Spectral Phase Transition and Optimal PCA in Block-Structured Spiked models","created":"2024-03-06","cited_by_count":4,"area":null},{"id":"2407.03522","title":"Optimal thresholds and algorithms for a model of multi-modal learning in high dimensions","created":"2024-07-03","cited_by_count":4,"area":null},{"id":"2411.01974","title":"On the phase diagram of extensive-rank symmetric matrix denoising beyond rotational invariance","created":"2024-11-04","cited_by_count":4,"area":null},{"id":"2505.11139","title":"Covariance Density Neural Networks","created":"2025-05-16","cited_by_count":4,"area":null},{"id":"2603.11331","title":"Jailbreak Scaling Laws for Large Language Models: Polynomial-Exponential Crossover","created":"2026-03-11","cited_by_count":4,"area":"alignment"},{"id":"2112.00183","title":"Descriptive vs. inferential community detection in networks: pitfalls, myths, and half-truths","created":"2021-11-30","cited_by_count":3,"area":null},{"id":"2211.02778","title":"Near-optimal multiple testing in Bayesian linear models with finite-sample FDR control","created":"2022-11-04","cited_by_count":3,"area":null},{"id":"2312.14922","title":"Learning from higher-order statistics, efficiently: hypothesis tests, random features, and neural networks","created":"2023-12-22","cited_by_count":3,"area":null},{"id":"2401.17269","title":"Effect of Weight Quantization on Learning Models by Typical Case Analysis","created":"2024-01-30","cited_by_count":3,"area":null},{"id":"2402.03169","title":"A Random Matrix Approach to Low-Multilinear-Rank Tensor Approximation","created":"2024-02-05","cited_by_count":3,"area":null},{"id":"2404.03272","title":"Cryptographic Hardness of Score Estimation","created":"2024-04-04","cited_by_count":3,"area":null},{"id":"2404.13404","title":"Solution space and storage capacity of fully connected two-layer neural networks with generic activation functions","created":"2024-04-20","cited_by_count":3,"area":null},{"id":"2406.16988","title":"MD tree: a model-diagnostic tree grown on loss landscape","created":"2024-06-24","cited_by_count":3,"area":null},{"id":"2408.15418","title":"Understanding GNNs for Boolean Satisfiability through Approximation Algorithms","created":"2024-08-27","cited_by_count":3,"area":null},{"id":"2410.18858","title":"Bilinear Sequence Regression: A Model for Learning from Long Sequences of High-dimensional Tokens","created":"2024-10-24","cited_by_count":3,"area":null},{"id":"2502.09832","title":"Computational Lower Bounds for Correlated Random Graphs via Algorithmic Contiguity","created":"2025-02-14","cited_by_count":3,"area":null},{"id":"2504.18072","title":"A Model Zoo on Phase Transitions in Neural Networks","created":"2025-04-25","cited_by_count":3,"area":null},{"id":"2506.01582","title":"Bayes optimal learning of attention-indexed models","created":"2025-06-02","cited_by_count":3,"area":null},{"id":"2105.07416","title":"Bayesian reconstruction of memories stored in neural networks from their connectivity","created":"2021-05-16","cited_by_count":2,"area":null},{"id":"2110.01901","title":"Inferring Hidden Structures in Random Graphs","created":"2021-10-05","cited_by_count":2,"area":null},{"id":"2112.09420","title":"A random energy approach to deep learning","created":"2021-12-17","cited_by_count":2,"area":null},{"id":"2302.03658","title":"Planted Bipartite Graph Detection","created":"2023-02-07","cited_by_count":2,"area":null},{"id":"2403.04234","title":"Fundamental limits of Non-Linear Low-Rank Matrix Estimation","created":"2024-03-07","cited_by_count":2,"area":null},{"id":"2410.16493","title":"Building Conformal Prediction Intervals with Approximate Message Passing","created":"2024-10-21","cited_by_count":2,"area":null},{"id":"2502.15131","title":"Optimal and Provable Calibration in High-Dimensional Binary Classification: Angular Calibration and Platt Scaling","created":"2025-02-21","cited_by_count":2,"area":null},{"id":"2503.06181","title":"Make Haste Slowly: A Theory of Emergent Structured Mixed Selectivity in Feature Learning ReLU Networks","created":"2025-03-08","cited_by_count":2,"area":null},{"id":"2506.06259","title":"An Optimized Franz-Parisi Criterion and its Equivalence with SQ Lower Bounds","created":"2025-06-06","cited_by_count":2,"area":null},{"id":"2510.01930","title":"Precise Dynamics of Diagonal Linear Networks: A Unifying Analysis by Dynamical Mean-Field Theory","created":"2025-10-02","cited_by_count":2,"area":null},{"id":"2603.17896","title":"A Noise Sensitivity Exponent Controls Large Statistical-to-Computational Gaps in Single- and Multi-Index Models","created":"2026-03-18","cited_by_count":2,"area":null},{"id":"2111.13302","title":"Equivalence between algorithmic instability and transition to replica symmetry breaking in perceptron learning systems","created":"2021-11-26","cited_by_count":1,"area":null},{"id":"2209.05464","title":"Understanding the Behavior of Belief Propagation","created":"2022-09-05","cited_by_count":1,"area":null},{"id":"2307.13535","title":"Do algorithms and barriers for sparse principal component analysis extend to other structured settings?","created":"2023-07-25","cited_by_count":1,"area":null},{"id":"2308.03743","title":"The Copycat Perceptron: Smashing Barriers Through Collective Learning","created":"2023-08-07","cited_by_count":1,"area":"distill"},{"id":"2501.01963","title":"Statistical learning does not always entail knowledge","created":"2024-12-17","cited_by_count":1,"area":null},{"id":"2502.16292","title":"Generative diffusion for perceptron problems: statistical physics analysis and efficient algorithms","created":"2025-02-22","cited_by_count":1,"area":null},{"id":"2504.11830","title":"Emergence of Computational Structure in a Neural Network Physics Simulator","created":"2025-04-16","cited_by_count":1,"area":null},{"id":"2508.07397","title":"A Spin Glass Characterization of Neural Networks","created":"2025-08-10","cited_by_count":1,"area":null},{"id":"2508.10520","title":"Nonlocal Monte Carlo via Reinforcement Learning","created":"2025-08-14","cited_by_count":1,"area":"deeprl"},{"id":"2603.18254","title":"Computation-Utility-Privacy Tradeoffs in Bayesian Estimation","created":"2026-03-18","cited_by_count":1,"area":null},{"id":"2605.14059","title":"Finite-size scaling of hetero-associative retrieval in continuous-signal-driven Ising spin systems","created":"2026-05-13","cited_by_count":1,"area":null},{"id":"2605.29153","title":"Unveiling Multi-regime Patterns in SciML: Distinct Failure Modes and Regime-specific Optimization","created":"2026-05-27","cited_by_count":1,"area":null}],"next_cursor":"100"}