{"total":57,"rows":[{"id":"2310.06110","title":"Grokking as the Transition from Lazy to Rich Training Dynamics","created":"2023-10-09","cited_by_count":108,"area":null},{"id":"2305.18270","title":"How Two-Layer Neural Networks Learn, One (Giant) Step at a Time","created":"2023-05-29","cited_by_count":68,"area":null},{"id":"2310.19793","title":"On Learning Gaussian Multi-index Models with Gradient Flow","created":"2023-10-30","cited_by_count":57,"area":null},{"id":"2306.17759","title":"The Shaped Transformer: Attention Models in the Infinite Depth-and-Width Limit","created":"2023-06-30","cited_by_count":47,"area":null},{"id":"2402.01258","title":"Transformers Learn Nonlinear Features In Context: Nonconvex Mean-field Dynamics on the Attention Landscape","created":"2024-02-02","cited_by_count":46,"area":null},{"id":"2406.01581","title":"Neural network learns low-dimensional polynomials with SGD near the information-theoretic limit","created":"2024-06-03","cited_by_count":46,"area":null},{"id":"2402.04980","title":"Asymptotics of feature learning in two-layer networks after one gradient-step","created":"2024-02-07","cited_by_count":38,"area":null},{"id":"2309.03843","title":"Gradient-Based Feature Learning under Structured Data","created":"2023-09-07","cited_by_count":32,"area":null},{"id":"2411.02544","title":"Pretrained transformer efficiently learns low-dimensional target functions in-context","created":"2024-11-04","cited_by_count":31,"area":null},{"id":"2509.25040","title":"A multiscale analysis of mean-field transformers in the moderate interaction regime","created":"2025-09-29","cited_by_count":25,"area":null},{"id":"2410.19637","title":"A distributional simplicity bias in the learning dynamics of transformers","created":"2024-10-25","cited_by_count":24,"area":null},{"id":"2311.03794","title":"On the Impact of Overparameterization on the Training of a Shallow Neural Network in High Dimensions","created":"2023-11-07","cited_by_count":21,"area":"distill"},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2405.15480","title":"Fundamental computational limits of weak learnability in high-dimensional multi-index models","created":"2024-05-24","cited_by_count":19,"area":null},{"id":"2307.15804","title":"On Single Index Models beyond Gaussian Data","created":"2023-07-28","cited_by_count":17,"area":null},{"id":"2410.01537","title":"Attention layers provably solve single-location regression","created":"2024-10-02","cited_by_count":17,"area":null},{"id":"2410.18938","title":"A Random Matrix Theory Perspective on the Spectrum of Learned Features and Asymptotic Generalization Capabilities","created":"2024-10-24","cited_by_count":16,"area":null},{"id":"2305.18502","title":"Escaping mediocrity: how two-layer networks learn hard generalized linear models with SGD","created":"2023-05-29","cited_by_count":15,"area":null},{"id":"2408.07254","title":"Learning Multi-Index Models with Neural Networks via Mean-Field Langevin Dynamics","created":"2024-08-14","cited_by_count":15,"area":null},{"id":"2504.05426","title":"Survey on Algorithms for multi-index models","created":"2025-04-07","cited_by_count":15,"area":null},{"id":"2512.20607","title":"Saddle-to-Saddle Dynamics Explains A Simplicity Bias Across Neural Network Architectures","created":"2025-12-23","cited_by_count":15,"area":null},{"id":"2506.06489","title":"Alternating Gradient Flows: A Theory of Feature Learning in Two-layer Neural Networks","created":"2025-06-06","cited_by_count":14,"area":null},{"id":"2406.11828","title":"Learning sum of diverse features: computational hardness and efficient gradient-based training for ridge combinations","created":"2024-06-17","cited_by_count":13,"area":null},{"id":"2404.08602","title":"Sliding down the stairs: how correlated latent variables accelerate learning with neural networks","created":"2024-04-12","cited_by_count":12,"area":null},{"id":"2305.06435","title":"Phase transitions in the mini-batch size for sparse and dense two-layer neural networks","created":"2023-05-10","cited_by_count":9,"area":null},{"id":"2411.08798","title":"Learning Gaussian Multi-Index Models with Gradient Flow: Time Complexity and Directional Convergence","created":"2024-11-13","cited_by_count":9,"area":null},{"id":"2506.02651","title":"Asymptotics of SGD in Sequence-Single Index Models and Single-Layer Attention Networks","created":"2025-06-03","cited_by_count":9,"area":null},{"id":"2311.01644","title":"Should Under-parameterized Student Networks Copy or Average Teacher Weights?","created":"2023-11-03","cited_by_count":8,"area":null},{"id":"2502.06443","title":"Low-dimensional Functions are Efficiently Learnable under Randomly Biased Distributions","created":"2025-02-10","cited_by_count":8,"area":null},{"id":"2502.02545","title":"Optimal Spectral Transitions in High-Dimensional Multi-Index Models","created":"2025-02-04","cited_by_count":7,"area":null},{"id":"2509.24914","title":"Single-Head Attention in High Dimensions: A Theory of Generalization, Weights Spectra, and Scaling Laws","created":"2025-09-29","cited_by_count":6,"area":null},{"id":"2402.05013","title":"Compression of Structured Data with Autoencoders: Provable Benefit of Nonlinearities and Depth","created":"2024-02-07","cited_by_count":5,"area":null},{"id":"2410.05448","title":"Task Diversity Shortens the ICL Plateau","created":"2024-10-07","cited_by_count":5,"area":null},{"id":"2504.18208","title":"Ultra-fast feature learning for the training of two-layer neural networks in the two-timescale regime","created":"2025-04-25","cited_by_count":5,"area":null},{"id":"2510.04606","title":"Closed-Form Last Layer Optimization","created":"2025-10-06","cited_by_count":5,"area":null},{"id":"2603.12901","title":"A theory of learning data statistics in diffusion models, from easy to hard","created":"2026-03-13","cited_by_count":5,"area":"diffusion"},{"id":"2402.16793","title":"Failures and Successes of Cross-Validation for Early-Stopped Gradient Descent","created":"2024-02-26","cited_by_count":4,"area":null},{"id":"2406.02157","title":"Online Learning and Information Exponents: On The Importance of Batch size, and Time/Complexity Tradeoffs","created":"2024-06-04","cited_by_count":3,"area":null},{"id":"2506.01582","title":"Bayes optimal learning of attention-indexed models","created":"2025-06-02","cited_by_count":3,"area":null},{"id":"2509.25741","title":"Test time training enhances in-context learning of nonlinear functions","created":"2025-09-30","cited_by_count":3,"area":null},{"id":"2606.05899","title":"High-Dimensional Theory of LoRA Fine-Tuning in a Solvable Attention Model","created":"2026-06-04","cited_by_count":3,"area":null},{"id":"2501.17122","title":"Convergence of two-timescale gradient descent ascent dynamics: finite-dimensional and mean-field perspectives","created":"2025-01-28","cited_by_count":2,"area":null},{"id":"2510.21020","title":"From Information to Generative Exponent: Learning Rate Induces Phase Transitions in SGD","created":"2025-10-23","cited_by_count":2,"area":null},{"id":"2603.17896","title":"A Noise Sensitivity Exponent Controls Large Statistical-to-Computational Gaps in Single- and Multi-Index Models","created":"2026-03-18","cited_by_count":2,"area":null},{"id":"2604.09412","title":"Sharp description of local minima in the loss landscape of high-dimensional two-layer ReLU neural networks","created":"2026-04-10","cited_by_count":2,"area":"distill"},{"id":"2505.21336","title":"Joint Learning in the Gaussian Single Index Model","created":"2025-05-27","cited_by_count":1,"area":null},{"id":"2601.22450","title":"Tuning the Implicit Regularizer of Masked Diffusion Language Models: Enhancing Generalization via Insights from $k$-Parity","created":"2026-01-30","cited_by_count":1,"area":"diffusion"},{"id":"2604.03068","title":"Escape dynamics and implicit bias of one-pass SGD in overparameterized quadratic networks","created":"2026-04-03","cited_by_count":1,"area":null},{"id":"2605.12908","title":"The Mechanism of Weak-to-Strong Generalization: Feature Elicitation from Latent Knowledge","created":"2026-05-13","cited_by_count":1,"area":null},{"id":"2508.04883","title":"Gaussian mixture layers for neural networks","created":"2025-08-06","cited_by_count":0,"area":null},{"id":"2510.19382","title":"A Derandomization Framework for Structure Discovery: Applications in Neural Networks and Beyond","created":"2025-10-22","cited_by_count":0,"area":null},{"id":"2602.00172","title":"Neuron Block Dynamics for XOR Classification with Zero-Margin","created":"2026-01-30","cited_by_count":0,"area":null},{"id":"2602.07378","title":"Dichotomy of Feature Learning and Unlearning: Fast-Slow Analysis on Neural Networks with Stochastic Gradient Descent","created":"2026-02-07","cited_by_count":0,"area":"safety"},{"id":"2604.02393","title":"Plateaus, Optima, and Overfitting in Multi-Layer Perceptrons: A Saddle-Saddle-Attractor Scenario","created":"2026-04-02","cited_by_count":0,"area":null},{"id":"2605.16913","title":"A Fourier perspective on the learning dynamics of neural networks: from sample complexities to mechanistic insights","created":"2026-05-16","cited_by_count":0,"area":null},{"id":"2607.10869","title":"Singular perturbations and hierarchical learning in two-layer neural networks","created":"2026-07-12","cited_by_count":0,"area":null},{"id":"2609.34667","title":"Two-Timescale Fine-tuning Provably Learns New Features for Two-Layer ReLU Networks","created":"2026-09-28","cited_by_count":0,"area":null}],"next_cursor":null}