{"total":107,"rows":[{"id":"2101.12699","title":"Exploring Deep Neural Networks via Layer-Peeled Model: Minority Collapse in Imbalanced Training","created":"2021-01-29","cited_by_count":166,"area":null},{"id":"2206.15144","title":"Neural Networks can Learn Representations with Gradient Descent","created":"2022-06-30","cited_by_count":161,"area":null},{"id":"2107.04384","title":"Continual Learning in the Teacher-Student Setup: Impact of Task Similarity","created":"2021-07-09","cited_by_count":88,"area":"distill"},{"id":"2106.15013","title":"Small random initialization is akin to spectral learning: Optimization and generalization guarantees for overparameterized low-rank matrix reconstruction","created":"2021-06-28","cited_by_count":78,"area":null},{"id":"2505.01618","title":"Don't be lazy: CompleteP enables compute-efficient deep transformers","created":"2025-05-02","cited_by_count":78,"area":null},{"id":"2206.04030","title":"High-dimensional limit theorems for SGD: Effective dynamics and critical scaling","created":"2022-06-08","cited_by_count":70,"area":null},{"id":"2102.11742","title":"Classifying high-dimensional Gaussian mixtures: Where kernel methods fail and neural networks succeed","created":"2021-02-23","cited_by_count":69,"area":null},{"id":"2201.07395","title":"Overview frequency principle/spectral bias in deep learning","created":"2022-01-19","cited_by_count":69,"area":null},{"id":"2305.18270","title":"How Two-Layer Neural Networks Learn, One (Giant) Step at a Time","created":"2023-05-29","cited_by_count":68,"area":null},{"id":"2201.10469","title":"Convex Analysis of the Mean Field Langevin Dynamics","created":"2022-01-25","cited_by_count":55,"area":null},{"id":"2402.03220","title":"The Benefits of Reusing Batches for Gradient Descent in Two-Layer Networks: Breaking the Curse of Information and Leap Exponents","created":"2024-02-05","cited_by_count":52,"area":null},{"id":"2202.00293","title":"Phase diagram of Stochastic Gradient Descent in high-dimensional two-layer neural networks","created":"2022-02-01","cited_by_count":50,"area":null},{"id":"2310.07891","title":"A Theory of Non-Linear Feature Learning with One Gradient Step in Two-Layer Neural Networks","created":"2023-10-11","cited_by_count":49,"area":null},{"id":"2102.02410","title":"A Local Convergence Theory for Mildly Over-Parameterized Two-Layer Neural Network","created":"2021-02-04","cited_by_count":47,"area":null},{"id":"2106.03795","title":"Heavy Tails in SGD and Compressibility of Overparametrized Neural Networks","created":"2021-06-07","cited_by_count":44,"area":null},{"id":"2302.05882","title":"From high-dimensional & mean-field dynamics to dimensionless ODEs: A unifying approach to SGD in two-layers networks","created":"2023-02-12","cited_by_count":43,"area":null},{"id":"2105.14573","title":"Embedding Principle of Loss Landscape of Deep Neural Networks","created":"2021-05-30","cited_by_count":38,"area":null},{"id":"2402.04980","title":"Asymptotics of feature learning in two-layer networks after one gradient-step","created":"2024-02-07","cited_by_count":38,"area":null},{"id":"2106.08929","title":"KALE Flow: A Relaxed KL Gradient Flow for Probabilities with Disjoint Support","created":"2021-06-16","cited_by_count":37,"area":null},{"id":"2207.10430","title":"The Neural Race Reduction: Dynamics of Abstraction in Gated Networks","created":"2022-07-21","cited_by_count":37,"area":null},{"id":"2405.15459","title":"Repetita Iuvant: Data Repetition Allows SGD to Learn High-Dimensional Multi-Index Functions","created":"2024-05-24","cited_by_count":37,"area":null},{"id":"2105.11686","title":"Towards Understanding the Condensation of Neural Networks at Initial Training","created":"2021-05-25","cited_by_count":32,"area":null},{"id":"2212.14457","title":"Bayesian Interpolation with Deep Linear Networks","created":"2022-12-29","cited_by_count":21,"area":null},{"id":"2106.06573","title":"Understanding Deflation Process in Over-parametrized Tensor Decomposition","created":"2021-06-11","cited_by_count":20,"area":null},{"id":"2306.07221","title":"Convergence of mean-field Langevin dynamics: Time and space discretization, stochastic gradient, and variance reduction","created":"2023-06-12","cited_by_count":20,"area":null},{"id":"2307.06092","title":"Quantitative CLTs in Deep Neural Networks","created":"2023-07-12","cited_by_count":20,"area":null},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2304.09576","title":"Leveraging the two timescale regime to demonstrate convergence of neural networks","created":"2023-04-19","cited_by_count":19,"area":null},{"id":"2206.00860","title":"Self-Consistency of the Fokker-Planck Equation","created":"2022-06-02","cited_by_count":18,"area":null},{"id":"2205.12101","title":"Empirical Phase Diagram for Three-layer Neural Networks with Infinite Width","created":"2022-05-24","cited_by_count":17,"area":null},{"id":"2405.05409","title":"Initialization is Critical to Whether Transformers Fit Composite Functions by Reasoning or Memorizing","created":"2024-05-08","cited_by_count":17,"area":null},{"id":"2504.09484","title":"An overview of condensation phenomenon in deep learning","created":"2025-04-13","cited_by_count":17,"area":null},{"id":"2212.14852","title":"An Analysis of Attention via the Lens of Exchangeability and Latent Variable Models","created":"2022-12-30","cited_by_count":16,"area":null},{"id":"2303.06561","title":"Phase Diagram of Initial Condensation for Two-layer Neural Networks","created":"2023-03-12","cited_by_count":16,"area":null},{"id":"2410.18938","title":"A Random Matrix Theory Perspective on the Spectrum of Learned Features and Asymptotic Generalization Capabilities","created":"2024-10-24","cited_by_count":16,"area":null},{"id":"2108.13097","title":"A theory of representation learning gives a deep generalisation of kernel methods","created":"2021-08-30","cited_by_count":15,"area":null},{"id":"2305.18502","title":"Escaping mediocrity: how two-layer networks learn hard generalized linear models with SGD","created":"2023-05-29","cited_by_count":15,"area":null},{"id":"2407.05622","title":"On the Complexity of Learning Sparse Functions with Statistical and Gradient Queries","created":"2024-07-08","cited_by_count":15,"area":null},{"id":"2102.00200","title":"Linear Frequency Principle Model to Understand the Absence of Overfitting in Neural Networks","created":"2021-01-30","cited_by_count":14,"area":null},{"id":"2209.13565","title":"Neural parameter calibration for large-scale multi-agent models","created":"2022-09-27","cited_by_count":14,"area":null},{"id":"2307.05635","title":"Fundamental limits of overparametrized shallow neural networks for supervised learning","created":"2023-07-11","cited_by_count":13,"area":null},{"id":"2405.15767","title":"Improved Particle Approximation Error for Mean Field Neural Networks","created":"2024-05-24","cited_by_count":12,"area":null},{"id":"2101.07833","title":"Implicit Bias of Linear RNNs","created":"2021-01-19","cited_by_count":11,"area":null},{"id":"2306.16308","title":"Gaussian random field approximation via Stein's method with applications to wide random neural networks","created":"2023-06-28","cited_by_count":11,"area":null},{"id":"2406.16689","title":"Coding schemes in neural networks learning classification tasks","created":"2024-06-24","cited_by_count":11,"area":null},{"id":"2106.03485","title":"Redundant representations help generalization in wide neural networks","created":"2021-06-07","cited_by_count":9,"area":null},{"id":"2110.06482","title":"Parallel Deep Neural Networks Have Zero Duality Gap","created":"2021-10-13","cited_by_count":9,"area":null},{"id":"2202.10947","title":"Provably convergent quasistatic dynamics for mean-field two-player zero-sum games","created":"2022-02-15","cited_by_count":9,"area":null},{"id":"2304.01063","title":"Depth Separation with Multilayer Mean-Field Networks","created":"2023-04-03","cited_by_count":9,"area":null},{"id":"2506.02651","title":"Asymptotics of SGD in Sequence-Single Index Models and Single-Layer Attention Networks","created":"2025-06-03","cited_by_count":9,"area":null},{"id":"2104.07531","title":"On Energy-Based Models with Overparametrized Shallow Neural Networks","created":"2021-04-15","cited_by_count":8,"area":null},{"id":"2107.05134","title":"Dual Training of Energy-Based Models with Overparametrized Shallow Neural Networks","created":"2021-07-11","cited_by_count":8,"area":null},{"id":"2305.09947","title":"Understanding the Initial Condensation of Convolutional Neural Networks","created":"2023-05-17","cited_by_count":8,"area":null},{"id":"2112.13530","title":"Wasserstein Flow Meets Replicator Dynamics: A Mean-Field Analysis of Representation Learning in Actor-Critic","created":"2021-12-27","cited_by_count":7,"area":null},{"id":"2302.07125","title":"Stochastic Modified Flows, Mean-Field Limits and Dynamics of Stochastic Gradient Descent","created":"2023-02-14","cited_by_count":7,"area":null},{"id":"2209.01018","title":"Normalization effects on deep neural networks","created":"2022-09-02","cited_by_count":6,"area":null},{"id":"2304.00707","title":"High-dimensional scaling limits and fluctuations of online least-squares SGD with smooth covariance","created":"2023-04-03","cited_by_count":6,"area":null},{"id":"2110.15954","title":"Limiting fluctuation and trajectorial stability of multilayer neural networks with mean field training","created":"2021-10-29","cited_by_count":5,"area":null},{"id":"2210.11452","title":"Global Convergence of SGD On Two Layer Neural Nets","created":"2022-10-20","cited_by_count":5,"area":null},{"id":"2303.02957","title":"Primal and Dual Analysis of Entropic Fictitious Play for Finite-sum Problems","created":"2023-03-06","cited_by_count":4,"area":null},{"id":"2501.19122","title":"FedRTS: Federated Robust Pruning via Combinatorial Thompson Sampling","created":"2025-01-31","cited_by_count":4,"area":null},{"id":"2503.09565","title":"Global Convergence and Rich Feature Learning in $L$-Layer Infinite-Width Neural Networks under $\\mu$P Parametrization","created":"2025-03-12","cited_by_count":4,"area":null},{"id":"2510.01303","title":"Low Rank Gradients and Where to Find Them","created":"2025-10-01","cited_by_count":4,"area":null},{"id":"2111.09459","title":"Gradient flows on graphons: existence, convergence, continuity equations","created":"2021-11-18","cited_by_count":3,"area":null},{"id":"2205.09860","title":"Mean-Field Analysis of Two-Layer Neural Networks: Global Optimality with Linear Convergence Rates","created":"2022-05-19","cited_by_count":3,"area":null},{"id":"2207.05705","title":"Conservative SPDEs as fluctuating mean field limits of stochastic gradient descent","created":"2022-07-12","cited_by_count":3,"area":null},{"id":"2210.06819","title":"Mean-field analysis for heavy ball methods: Dropout-stability, connectivity, and global convergence","created":"2022-10-13","cited_by_count":3,"area":null},{"id":"2210.16286","title":"A Functional-Space Mean-Field Theory of Partially-Trained Three-Layer Neural Networks","created":"2022-10-28","cited_by_count":3,"area":null},{"id":"2311.06138","title":"Minimum norm interpolation by perceptra: Explicit regularization and implicit bias","created":"2023-11-10","cited_by_count":3,"area":null},{"id":"2402.15958","title":"On the dynamics of three-layer neural networks: initial condensation","created":"2024-02-25","cited_by_count":3,"area":null},{"id":"2403.09889","title":"Generalization of Scaled Deep ResNets in the Mean-Field Regime","created":"2024-03-14","cited_by_count":3,"area":null},{"id":"2406.02157","title":"Online Learning and Information Exponents: On The Importance of Batch size, and Time/Complexity Tradeoffs","created":"2024-06-04","cited_by_count":3,"area":null},{"id":"2505.02621","title":"Mirror Mean-Field Langevin Dynamics","created":"2025-05-05","cited_by_count":3,"area":null},{"id":"2312.16360","title":"Mean-field underdamped Langevin dynamics and its spacetime discretization","created":"2023-12-26","cited_by_count":2,"area":null},{"id":"2405.19995","title":"Symmetries in Overparametrized Neural Networks: A Mean-Field View","created":"2024-05-30","cited_by_count":2,"area":null},{"id":"2410.16151","title":"Small Contributions, Small Networks: Efficient Neural Network Pruning Based on Relative Importance","created":"2024-10-21","cited_by_count":2,"area":null},{"id":"2505.22760","title":"Non-convex entropic mean-field optimization via Best Response flow","created":"2025-05-28","cited_by_count":2,"area":null},{"id":"2102.07541","title":"WGAN with an Infinitely Wide Generator Has No Spurious Stationary Points","created":"2021-02-15","cited_by_count":1,"area":null},{"id":"2210.13879","title":"Proximal Mean Field Learning in Shallow Neural Networks","created":"2022-10-25","cited_by_count":1,"area":null},{"id":"2311.14120","title":"Weight fluctuations in (deep) linear neural networks and a derivation of the inverse-variance flatness relation","created":"2023-11-23","cited_by_count":1,"area":null},{"id":"2402.08948","title":"Mean-Field Analysis for Learning Subspace-Sparse Polynomials with Gaussian Input","created":"2024-02-14","cited_by_count":1,"area":null},{"id":"2406.05666","title":"Probability Distribution Learning and Its Application in Deep Learning","created":"2024-06-09","cited_by_count":1,"area":null},{"id":"2410.20119","title":"On Multi-Stage Loss Dynamics in Neural Networks: Mechanisms of Plateau and Descent Stages","created":"2024-10-26","cited_by_count":1,"area":null},{"id":"2411.19193","title":"Convex Regularization and Convergence of Policy Gradient Flows under Safety Constraints","created":"2024-11-28","cited_by_count":1,"area":"deeprl"},{"id":"2502.03359","title":"GHOST: Gaussian Hypothesis Open-Set Technique","created":"2025-02-05","cited_by_count":1,"area":null},{"id":"2505.23013","title":"Scalable Complexity Control Facilitates Reasoning Ability of LLMs","created":"2025-05-29","cited_by_count":1,"area":"lr"},{"id":"2510.03246","title":"StructPrune: Structured Global Pruning asymptotics with $\\mathcal{O}(\\sqrt{N})$ GPU Memory","created":"2025-09-25","cited_by_count":1,"area":null},{"id":"2511.02258","title":"Limit Theorems for Stochastic Gradient Descent in High-Dimensional Single-Layer Networks","created":"2025-11-04","cited_by_count":1,"area":null},{"id":"2511.21466","title":"Mean-Field Model for Two-Layer Neural Networks Trained with Consensus-Based Optimization","created":"2025-11-26","cited_by_count":1,"area":null},{"id":"2601.14792","title":"Robustness of Mixtures of Experts to Feature Noise","created":"2026-01-21","cited_by_count":1,"area":"moe"},{"id":"2604.03068","title":"Escape dynamics and implicit bias of one-pass SGD in overparameterized quadratic networks","created":"2026-04-03","cited_by_count":1,"area":null},{"id":"2605.06599","title":"Weight-Decay Turns Transformer Loss Landscapes Villani: Functional-Analytic Foundations for Optimization and Generalization","created":"2026-05-07","cited_by_count":1,"area":null},{"id":"2112.00732","title":"Asymptotic properties of one-layer artificial neural networks with sparse connectivity","created":"2021-12-01","cited_by_count":0,"area":null},{"id":"2202.08930","title":"A Distributed Algorithm for Measure-valued Optimization with Additive Objective","created":"2022-02-17","cited_by_count":0,"area":null},{"id":"2310.10791","title":"Neural Tangent Kernels Motivate Graph Neural Networks with Cross-Covariance Graphs","created":"2023-10-16","cited_by_count":0,"area":null},{"id":"2406.04567","title":"Error Bounds of Supervised Classification from Information-Theoretic Perspective","created":"2024-06-07","cited_by_count":0,"area":null},{"id":"2406.09048","title":"Central Limit Theorem for Bayesian Neural Network trained with Variational Inference","created":"2024-06-10","cited_by_count":0,"area":null},{"id":"2410.01944","title":"Debiased Orthogonal Boundary-Driven Efficient Noise Mitigation","created":"2024-10-02","cited_by_count":0,"area":null},{"id":"2410.05807","title":"Extended convexity and smoothness and their applications in deep learning","created":"2024-10-08","cited_by_count":0,"area":null},{"id":"2503.23016","title":"Towards Understanding the Optimization Mechanisms in Deep Learning","created":"2025-03-29","cited_by_count":0,"area":null}],"next_cursor":"100"}