{"total":58,"rows":[{"id":"2107.04384","title":"Continual Learning in the Teacher-Student Setup: Impact of Task Similarity","created":"2021-07-09","cited_by_count":88,"area":"distill"},{"id":"2201.07395","title":"Overview frequency principle/spectral bias in deep learning","created":"2022-01-19","cited_by_count":69,"area":null},{"id":"2106.03791","title":"Learning Gaussian Mixtures with Generalised Linear Models: Precise Asymptotics in High-dimensions","created":"2021-06-07","cited_by_count":54,"area":null},{"id":"2402.03220","title":"The Benefits of Reusing Batches for Gradient Descent in Two-Layer Networks: Breaking the Curse of Information and Leap Exponents","created":"2024-02-05","cited_by_count":52,"area":null},{"id":"2202.00293","title":"Phase diagram of Stochastic Gradient Descent in high-dimensional two-layer neural networks","created":"2022-02-01","cited_by_count":50,"area":null},{"id":"2302.00375","title":"Bayes-optimal Learning of Deep Random Networks of Extensive-width","created":"2023-02-01","cited_by_count":41,"area":null},{"id":"2109.11905","title":"Graph-based Approximate Message Passing Iterations","created":"2021-09-24","cited_by_count":35,"area":null},{"id":"2402.03902","title":"A phase transition between positional and semantic learning in a solvable model of dot-product attention","created":"2024-02-06","cited_by_count":30,"area":null},{"id":"2604.21691","title":"There Will Be a Scientific Theory of Deep Learning","created":"2026-04-23","cited_by_count":29,"area":null},{"id":"2408.03733","title":"Bayes-optimal learning of an extensive-width neural network from quadratically many samples","created":"2024-08-07","cited_by_count":23,"area":null},{"id":"2106.10744","title":"On the Cryptographic Hardness of Learning Single Periodic Neurons","created":"2021-06-20","cited_by_count":20,"area":null},{"id":"2305.11041","title":"High-dimensional Asymptotics of Denoising Autoencoders","created":"2023-05-18","cited_by_count":19,"area":null},{"id":"2405.15480","title":"Fundamental computational limits of weak learnability in high-dimensional multi-index models","created":"2024-05-24","cited_by_count":19,"area":null},{"id":"2202.03295","title":"Theoretical characterization of uncertainty in high-dimensional linear classification","created":"2022-02-07","cited_by_count":18,"area":null},{"id":"2203.12094","title":"Learning curves for the multi-class teacher-student perceptron","created":"2022-03-22","cited_by_count":17,"area":"distill"},{"id":"2107.10370","title":"Analytic Study of Families of Spurious Minima in Two-Layer ReLU Neural Networks: A Tale of Symmetry II","created":"2021-07-21","cited_by_count":16,"area":null},{"id":"2210.12760","title":"On double-descent in uncertainty quantification in overparametrized models","created":"2022-10-23","cited_by_count":16,"area":null},{"id":"2504.05426","title":"Survey on Algorithms for multi-index models","created":"2025-04-07","cited_by_count":15,"area":null},{"id":"2506.06489","title":"Alternating Gradient Flows: A Theory of Feature Learning in Two-layer Neural Networks","created":"2025-06-06","cited_by_count":14,"area":null},{"id":"2103.05524","title":"On the interplay between data structure and loss function in classification problems","created":"2021-03-09","cited_by_count":13,"area":null},{"id":"2307.05635","title":"Fundamental limits of overparametrized shallow neural networks for supervised learning","created":"2023-07-11","cited_by_count":13,"area":null},{"id":"2409.13904","title":"High-dimensional learning of narrow neural networks","created":"2024-09-20","cited_by_count":12,"area":null},{"id":"2505.17958","title":"The Nuclear Route: Sharp Asymptotics of ERM in Overparameterized Quadratic Networks","created":"2025-05-23","cited_by_count":11,"area":null},{"id":"2210.06088","title":"Annihilation of Spurious Minima in Two-Layer ReLU Networks","created":"2022-10-12","cited_by_count":9,"area":null},{"id":"2505.24849","title":"Statistical mechanics of extensive-width Bayesian neural networks near interpolation","created":"2025-05-30","cited_by_count":9,"area":null},{"id":"2602.05846","title":"Optimal scaling laws in learning hierarchical multi-index models","created":"2026-02-05","cited_by_count":9,"area":null},{"id":"2201.08082","title":"Kernel Methods and Multi-layer Perceptrons Learn Linear Models in High Dimensions","created":"2022-01-20","cited_by_count":8,"area":null},{"id":"2502.01583","title":"Spectral Estimators for Multi-Index Models: Precise Asymptotics and Optimal Weak Recovery","created":"2025-02-03","cited_by_count":8,"area":null},{"id":"2602.10680","title":"A solvable high-dimensional model where nonlinear autoencoders learn structure invisible to PCA while test loss misaligns with generalization","created":"2026-02-11","cited_by_count":8,"area":null},{"id":"2502.02545","title":"Optimal Spectral Transitions in High-Dimensional Multi-Index Models","created":"2025-02-04","cited_by_count":7,"area":null},{"id":"2505.03577","title":"Information-theoretic reduction of deep neural networks to linear models in the overparametrized proportional regime","created":"2025-05-06","cited_by_count":6,"area":null},{"id":"2309.07663","title":"High-dimensional Asymptotics of VAEs: Threshold of Posterior Collapse and Dataset-Size Dependence of Rate-Distortion Curve","created":"2023-09-14","cited_by_count":5,"area":null},{"id":"2310.12612","title":"How a student becomes a teacher: learning and forgetting through Spectral methods","created":"2023-10-19","cited_by_count":5,"area":"distill"},{"id":"2312.13247","title":"Enhancing Neural Training via a Correlated Dynamics Model","created":"2023-12-20","cited_by_count":5,"area":null},{"id":"2602.10867","title":"Deep Learning of Compositional Targets with Hierarchical Spectral Methods","created":"2026-02-11","cited_by_count":5,"area":null},{"id":"2103.03703","title":"Semi-Supervised Federated Peer Learning for Skin Lesion Classification","created":"2021-03-05","cited_by_count":4,"area":null},{"id":"2402.13622","title":"Analysis of Bootstrap and Subsampling in High-dimensional Regularized Regression","created":"2024-02-21","cited_by_count":4,"area":null},{"id":"2304.02229","title":"Mixed Regression via Approximate Message Passing","created":"2023-04-05","cited_by_count":3,"area":"moe"},{"id":"2404.13404","title":"Solution space and storage capacity of fully connected two-layer neural networks with generic activation functions","created":"2024-04-20","cited_by_count":3,"area":null},{"id":"2506.01582","title":"Bayes optimal learning of attention-indexed models","created":"2025-06-02","cited_by_count":3,"area":null},{"id":"2312.16819","title":"Hidden Minima in Two-Layer ReLU Networks","created":"2023-12-28","cited_by_count":2,"area":null},{"id":"2404.13631","title":"Fermi-Bose Machine achieves both generalization and adversarial robustness","created":"2024-04-21","cited_by_count":2,"area":null},{"id":"2505.07792","title":"Analytic theory of dropout regularization","created":"2025-05-12","cited_by_count":2,"area":null},{"id":"2507.00629","title":"Generalization performance of narrow one-hidden layer networks in the teacher-student setting","created":"2025-07-01","cited_by_count":2,"area":"distill"},{"id":"2603.03993","title":"Specialization of softmax attention heads: insights from the high-dimensional single-location model","created":"2026-03-04","cited_by_count":2,"area":null},{"id":"2603.17896","title":"A Noise Sensitivity Exponent Controls Large Statistical-to-Computational Gaps in Single- and Multi-Index Models","created":"2026-03-18","cited_by_count":2,"area":null},{"id":"2102.13170","title":"Understanding Robustness in Teacher-Student Setting: A New Perspective","created":"2021-02-25","cited_by_count":1,"area":"distill"},{"id":"2409.06053","title":"Statistical Mechanics of Min-Max Problems","created":"2024-09-09","cited_by_count":1,"area":null},{"id":"2501.18530","title":"Optimal generalisation and learning transition in extensive-width shallow neural networks near interpolation","created":"2025-01-30","cited_by_count":1,"area":"distill"},{"id":"2604.03068","title":"Escape dynamics and implicit bias of one-pass SGD in overparameterized quadratic networks","created":"2026-04-03","cited_by_count":1,"area":null},{"id":"2605.23591","title":"Asymmetric Scaling Laws from Sparse Features","created":"2026-05-22","cited_by_count":1,"area":null},{"id":"2608.29472","title":"Knowledge Distillation under Teacher Misspecification: An Order-Parameter Analysis of the Gap between Teacher Mimicry and Task Performance","created":"2026-08-29","cited_by_count":1,"area":"distill"},{"id":"2111.03237","title":"Towards Designing Optimal Sensing Matrices for Generalized Linear Inverse Problems","created":"2021-11-05","cited_by_count":0,"area":null},{"id":"2510.24616","title":"Statistical physics of deep learning: Optimal learning of a multi-layer perceptron near interpolation","created":"2025-10-28","cited_by_count":0,"area":null},{"id":"2605.10395","title":"Sharp feature-learning transitions and Bayes-optimal neural scaling laws in extensive-width networks","created":"2026-05-11","cited_by_count":0,"area":null},{"id":"2608.09396","title":"From Objectives to What Models Learn: A Landau Theory of Invariant Learning","created":"2026-08-10","cited_by_count":0,"area":null},{"id":"2609.09595","title":"Teacher Geometry Shapes Learnability in Teacher-Student Networks","created":"2026-09-09","cited_by_count":0,"area":"distill"},{"id":"2609.34458","title":"Understanding Generalization Requires Universal Induction","created":"2026-09-28","cited_by_count":0,"area":null}],"next_cursor":null}