{"total":230,"rows":[{"id":"2307.05782","title":"Large Language Models","created":"2023-07-11","cited_by_count":780,"area":null},{"id":"2202.00622","title":"Datamodels: Predicting Predictions from Training Data","created":"2022-02-01","cited_by_count":189,"area":null},{"id":"2103.10427","title":"The Low-Rank Simplicity Bias in Deep Networks","created":"2021-03-18","cited_by_count":154,"area":null},{"id":"2205.01445","title":"High-dimensional Asymptotics of Feature Learning: How One Gradient Step Improves the Representation","created":"2022-05-03","cited_by_count":150,"area":null},{"id":"2105.14368","title":"Fit without fear: remarkable mathematical phenomena of deep learning through the prism of interpolation","created":"2021-05-29","cited_by_count":132,"area":null},{"id":"2308.08708","title":"Consciousness in Artificial Intelligence: Insights from the Science of Consciousness","created":"2023-08-17","cited_by_count":104,"area":null},{"id":"2404.09491","title":"Large Language Models Can Automatically Engineer Features for Few-Shot Tabular Learning","created":"2024-04-15","cited_by_count":81,"area":null},{"id":"2301.13105","title":"Generalization on the Unseen, Logic Reasoning and Degree Curriculum","created":"2023-01-30","cited_by_count":73,"area":null},{"id":"2109.02355","title":"A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learning","created":"2021-09-06","cited_by_count":57,"area":null},{"id":"2303.00055","title":"Learning time-scales in two-layers neural networks","created":"2023-02-28","cited_by_count":57,"area":null},{"id":"2210.04092","title":"Advancing Model Pruning via Bi-level Optimization","created":"2022-10-08","cited_by_count":56,"area":null},{"id":"2210.09974","title":"Theoretical Guarantees for Permutation-Equivariant Quantum Neural Networks","created":"2022-10-18","cited_by_count":52,"area":null},{"id":"2210.01513","title":"The Dynamics of Sharpness-Aware Minimization: Bouncing Across Ravines and Drifting Towards Wide Minima","created":"2022-10-04","cited_by_count":51,"area":null},{"id":"2303.01372","title":"High-dimensional analysis of double descent for linear regression with random projections","created":"2023-03-02","cited_by_count":47,"area":null},{"id":"2306.17759","title":"The Shaped Transformer: Attention Models in the Infinite Depth-and-Width Limit","created":"2023-06-30","cited_by_count":47,"area":null},{"id":"2206.02768","title":"The Neural Covariance SDE: Shaped Infinite Depth-and-Width Networks at Initialization","created":"2022-06-06","cited_by_count":41,"area":null},{"id":"2301.12832","title":"Deep networks for system identification: a Survey","created":"2023-01-30","cited_by_count":37,"area":null},{"id":"2205.10217","title":"Memorization and Optimization in Deep Neural Networks with Minimum Over-parameterization","created":"2022-05-20","cited_by_count":36,"area":null},{"id":"2207.06569","title":"Benign, Tempered, or Catastrophic: A Taxonomy of Overfitting","created":"2022-07-14","cited_by_count":36,"area":null},{"id":"2307.14619","title":"Provable Guarantees for Generative Behavior Cloning: Bridging Low-Level Stability and High-Level Behavior","created":"2023-07-27","cited_by_count":33,"area":null},{"id":"2310.02541","title":"Benign Overfitting and Grokking in ReLU Networks for XOR Cluster Data","created":"2023-10-04","cited_by_count":33,"area":null},{"id":"2301.11509","title":"Out-of-distributional risk bounds for neural operators with applications to the Helmholtz equation","created":"2023-01-27","cited_by_count":32,"area":null},{"id":"2211.06506","title":"Spectral Evolution and Invariance in Linear-width Neural Networks","created":"2022-11-11","cited_by_count":30,"area":null},{"id":"2403.02467","title":"Applied Causal Inference Powered by ML and AI","created":"2024-03-04","cited_by_count":30,"area":null},{"id":"2604.21691","title":"There Will Be a Scientific Theory of Deep Learning","created":"2026-04-23","cited_by_count":29,"area":null},{"id":"2208.14673","title":"Incremental Learning in Diagonal Linear Networks","created":"2022-08-31","cited_by_count":28,"area":null},{"id":"2407.20199","title":"Emergence in non-neural models: grokking modular arithmetic via average gradient outer product","created":"2024-07-29","cited_by_count":28,"area":null},{"id":"2202.04736","title":"Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets","created":"2022-02-09","cited_by_count":27,"area":null},{"id":"2211.13312","title":"A Moment-Matching Approach to Testable Learning and a New Characterization of Rademacher Complexity","created":"2022-11-23","cited_by_count":27,"area":null},{"id":"2107.12723","title":"Stability & Generalisation of Gradient Descent for Shallow Neural Networks without the Neural Tangent Kernel","created":"2021-07-27","cited_by_count":26,"area":null},{"id":"2110.03922","title":"The Eigenlearning Framework: A Conservation Law Perspective on Kernel Regression and Wide Neural Networks","created":"2021-10-08","cited_by_count":26,"area":null},{"id":"2305.14077","title":"Mind the spikes: Benign overfitting of kernels and neural networks in fixed dimension","created":"2023-05-23","cited_by_count":26,"area":null},{"id":"2203.16462","title":"Convergence of gradient descent for deep neural networks","created":"2022-03-30","cited_by_count":24,"area":null},{"id":"2306.08321","title":"Nonparametric regression using over-parameterized shallow ReLU neural networks","created":"2023-06-14","cited_by_count":24,"area":null},{"id":"2110.04629","title":"The Neural Testbed: Evaluating Joint Predictions","created":"2021-10-09","cited_by_count":22,"area":null},{"id":"2109.09304","title":"Deformed semicircle law and concentration of nonlinear random matrices for ultra-wide neural networks","created":"2021-09-20","cited_by_count":21,"area":null},{"id":"2209.09298","title":"Stability and Generalization Analysis of Gradient Methods for Shallow Neural Networks","created":"2022-09-19","cited_by_count":21,"area":null},{"id":"2305.01604","title":"The Training Process of Many Deep Networks Explores the Same Low-Dimensional Manifold","created":"2023-05-02","cited_by_count":21,"area":null},{"id":"2201.08924","title":"Nearest Class-Center Simplification through Intermediate Layers","created":"2022-01-21","cited_by_count":20,"area":null},{"id":"2307.06092","title":"Quantitative CLTs in Deep Neural Networks","created":"2023-07-12","cited_by_count":20,"area":null},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2401.07187","title":"A Survey on Statistical Theory of Deep Learning: Approximation, Training Dynamics, and Generative Models","created":"2024-01-14","cited_by_count":20,"area":null},{"id":"2501.13329","title":"Sparse identification of nonlinear dynamics and Koopman operators with Shallow Recurrent Decoder Networks","created":"2025-01-23","cited_by_count":20,"area":null},{"id":"2202.13361","title":"Benign Underfitting of Stochastic Gradient Descent","created":"2022-02-27","cited_by_count":19,"area":null},{"id":"2108.11489","title":"The Interplay Between Implicit Bias and Benign Overfitting in Two-Layer Linear Networks","created":"2021-08-25","cited_by_count":18,"area":null},{"id":"2310.10807","title":"Regularization properties of adversarially-trained linear regression","created":"2023-10-16","cited_by_count":18,"area":null},{"id":"2305.15141","title":"From Tempered to Benign Overfitting in ReLU Neural Networks","created":"2023-05-24","cited_by_count":16,"area":null},{"id":"2206.08756","title":"Tensor-on-Tensor Regression: Riemannian Optimization, Over-parameterization, Statistical-computational Gap, and Their Interplay","created":"2022-06-17","cited_by_count":15,"area":null},{"id":"2206.11655","title":"Optimizing Two-way Partial AUC with an End-to-end Framework","created":"2022-06-23","cited_by_count":15,"area":null},{"id":"2310.08513","title":"How connectivity structure shapes rich and lazy learning in neural circuits","created":"2023-10-12","cited_by_count":15,"area":null},{"id":"2410.01774","title":"Trained Transformer Classifiers Generalize and Exhibit Benign Overfitting In-Context","created":"2024-10-02","cited_by_count":15,"area":null},{"id":"2110.14163","title":"Does the Data Induce Capacity Control in Deep Learning?","created":"2021-10-27","cited_by_count":14,"area":null},{"id":"2111.05198","title":"Harmless interpolation in regression and classification with structured features","created":"2021-11-09","cited_by_count":14,"area":null},{"id":"2111.02278","title":"Mean-field Analysis of Piecewise Linear Solutions for Wide ReLU Networks","created":"2021-11-03","cited_by_count":13,"area":null},{"id":"2111.03084","title":"Binary perceptron: efficient algorithms can find solutions in a rare well-connected cluster","created":"2021-11-04","cited_by_count":13,"area":null},{"id":"2203.17209","title":"Adversarial Examples in Random Neural Networks with General Activations","created":"2022-03-31","cited_by_count":13,"area":null},{"id":"2206.03688","title":"Identifying good directions to escape the NTK regime and efficiently learn low-degree plus sparse polynomials","created":"2022-06-08","cited_by_count":13,"area":null},{"id":"2302.01629","title":"Beyond the Universal Law of Robustness: Sharper Laws for Random Features and Neural Tangent Kernels","created":"2023-02-03","cited_by_count":13,"area":null},{"id":"2309.05505","title":"Share Your Representation Only: Guaranteed Improvement of the Privacy-Utility Tradeoff in Federated Learning","created":"2023-09-11","cited_by_count":13,"area":null},{"id":"2402.13999","title":"Asymptotics of Learning with Deep Structured (Random) Features","created":"2024-02-21","cited_by_count":13,"area":null},{"id":"2112.02668","title":"On the Convergence of Shallow Neural Network Training with Randomly Masked Neurons","created":"2021-12-05","cited_by_count":11,"area":null},{"id":"2206.04743","title":"Strong Memory Lower Bounds for Learning Natural Models","created":"2022-06-09","cited_by_count":11,"area":null},{"id":"2304.13016","title":"Subsample Ridge Ensembles: Equivalences and Generalized Cross-Validation","created":"2023-04-25","cited_by_count":11,"area":null},{"id":"2305.12100","title":"How Spurious Features Are Memorized: Precise Analysis for Random and NTK Features","created":"2023-05-20","cited_by_count":11,"area":null},{"id":"2309.11617","title":"Statistical Complexity of Quantum Learning","created":"2023-09-20","cited_by_count":11,"area":null},{"id":"2310.00526","title":"Are Graph Neural Networks Optimal Approximation Algorithms?","created":"2023-10-01","cited_by_count":11,"area":null},{"id":"2406.00588","title":"Generalization Bound and New Algorithm for Clean-Label Backdoor Attack","created":"2024-06-02","cited_by_count":11,"area":null},{"id":"2406.07145","title":"Failures Are Fated, But Can Be Faded: Characterizing and Mitigating Unwanted Behaviors in Large-Scale Vision and Language Models","created":"2024-06-11","cited_by_count":11,"area":null},{"id":"2410.02348","title":"Simplicity bias and optimization threshold in two-layer ReLU networks","created":"2024-10-03","cited_by_count":11,"area":null},{"id":"2410.07041","title":"Emergent properties with repeated examples","created":"2024-10-09","cited_by_count":11,"area":null},{"id":"2506.10801","title":"Dense Associative Memory with Epanechnikov Energy","created":"2025-06-12","cited_by_count":11,"area":null},{"id":"2205.12937","title":"Mitigating multiple descents: A model-agnostic framework for risk monotonization","created":"2022-05-25","cited_by_count":10,"area":null},{"id":"2305.18496","title":"Generalized equivalences between subsampling and ridge regularization","created":"2023-05-29","cited_by_count":10,"area":null},{"id":"2506.03470","title":"Models of Heavy-Tailed Mechanistic Universality","created":"2025-06-04","cited_by_count":10,"area":null},{"id":"2208.07951","title":"On the generalization of learning algorithms that do not converge","created":"2022-08-16","cited_by_count":9,"area":null},{"id":"2305.16891","title":"Generalization Guarantees of Gradient Descent for Multi-Layer Neural Networks","created":"2023-05-26","cited_by_count":9,"area":null},{"id":"2502.01347","title":"Spurious Correlations in High Dimensional Regression: The Roles of Regularization, Simplicity Bias and Over-Parameterization","created":"2025-02-03","cited_by_count":9,"area":null},{"id":"2502.13283","title":"Benefits of Early Stopping in Gradient Descent for Overparameterized Logistic Regression","created":"2025-02-18","cited_by_count":9,"area":null},{"id":"2505.24849","title":"Statistical mechanics of extensive-width Bayesian neural networks near interpolation","created":"2025-05-30","cited_by_count":9,"area":null},{"id":"2206.01399","title":"Generalization for multiclass classification with overparameterized linear models","created":"2022-06-03","cited_by_count":8,"area":null},{"id":"2209.09315","title":"Deep Linear Networks can Benignly Overfit when Shallow Ones Do","created":"2022-09-19","cited_by_count":8,"area":null},{"id":"2309.10068","title":"A Unifying Perspective on Non-Stationary Kernels for Deeper Gaussian Processes","created":"2023-09-18","cited_by_count":8,"area":null},{"id":"2401.17898","title":"Multitask methods for predicting molecular properties from heterogeneous data","created":"2024-01-31","cited_by_count":8,"area":null},{"id":"2107.12685","title":"On the Role of Optimization in Double Descent: A Least Squares Study","created":"2021-07-27","cited_by_count":7,"area":null},{"id":"2108.03039","title":"Identifiable Energy-based Representations: An Application to Estimating Heterogeneous Causal Effects","created":"2021-08-06","cited_by_count":7,"area":null},{"id":"2110.09502","title":"Minimum $\\ell_{1}$-norm interpolators: Precise asymptotics and multiple descent","created":"2021-10-18","cited_by_count":7,"area":null},{"id":"2209.15106","title":"Restricted Strong Convexity of Deep Learning Models with Smooth Activations","created":"2022-09-29","cited_by_count":7,"area":null},{"id":"2211.06077","title":"Overparameterized random feature regression with nearly orthogonal data","created":"2022-11-11","cited_by_count":7,"area":null},{"id":"2310.18612","title":"Efficient kernel surrogates for neural network-based regression","created":"2023-10-28","cited_by_count":7,"area":null},{"id":"2410.06851","title":"Understanding Model Ensemble in Transferable Adversarial Attack","created":"2024-10-09","cited_by_count":7,"area":null},{"id":"2510.08123","title":"High-dimensional Analysis of Synthetic Data Selection","created":"2025-10-09","cited_by_count":7,"area":null},{"id":"2512.22768","title":"Understanding the Mechanisms of Fast Hyperparameter Transfer","created":"2025-12-28","cited_by_count":7,"area":null},{"id":"2110.10956","title":"Data splitting improves statistical performance in overparametrized regimes","created":"2021-10-21","cited_by_count":6,"area":null},{"id":"2306.11232","title":"Eight challenges in developing theory of intelligence","created":"2023-06-20","cited_by_count":6,"area":null},{"id":"2310.00176","title":"Universality of max-margin classifiers","created":"2023-09-29","cited_by_count":6,"area":null},{"id":"2402.02697","title":"Deep Equilibrium Models are Almost Equivalent to Not-so-deep Explicit Models for High-dimensional Gaussian Mixtures","created":"2024-02-05","cited_by_count":6,"area":null},{"id":"2402.10164","title":"Random features and polynomial rules","created":"2024-02-15","cited_by_count":6,"area":null},{"id":"2107.05341","title":"Nonparametric Regression with Shallow Overparameterized Neural Networks Trained by GD with Early Stopping","created":"2021-07-12","cited_by_count":5,"area":null},{"id":"2107.06825","title":"A Generalized Lottery Ticket Hypothesis","created":"2021-07-03","cited_by_count":5,"area":null},{"id":"2201.04545","title":"On generalization bounds for deep networks based on loss surface implicit regularization","created":"2022-01-12","cited_by_count":5,"area":null}],"next_cursor":"100"}