{"total":106,"rows":[{"id":"2303.14186","title":"TRAK: Attributing Model Behavior at Scale","created":"2023-03-24","cited_by_count":283,"area":null},{"id":"2402.01092","title":"A Dynamical Model of Neural Scaling Laws","created":"2024-02-02","cited_by_count":111,"area":null},{"id":"2310.17813","title":"A Spectral Condition for Feature Learning","created":"2023-10-26","cited_by_count":109,"area":null},{"id":"2205.09653","title":"Self-Consistent Dynamical Field Theory of Kernel Evolution in Wide Neural Networks","created":"2022-05-19","cited_by_count":105,"area":null},{"id":"2305.18270","title":"How Two-Layer Neural Networks Learn, One (Giant) Step at a Time","created":"2023-05-29","cited_by_count":68,"area":null},{"id":"2409.17858","title":"How Feature Learning Can Improve Neural Scaling Laws","created":"2024-09-26","cited_by_count":56,"area":null},{"id":"2112.15383","title":"Separation of Scales and a Thermodynamic Description of Feature Learning in Some CNNs","created":"2021-12-31","cited_by_count":53,"area":null},{"id":"2405.00592","title":"Scaling and renormalization in high-dimensional regression","created":"2024-05-01","cited_by_count":50,"area":null},{"id":"2203.09410","title":"A Framework and Benchmark for Deep Batch Active Learning for Regression","created":"2022-03-17","cited_by_count":49,"area":null},{"id":"2501.16265","title":"Training Dynamics of In-Context Learning in Linear Attention","created":"2025-01-27","cited_by_count":46,"area":null},{"id":"2304.03408","title":"Dynamics of Finite Width Kernel and Prediction Fluctuations in Mean Field Neural Networks","created":"2023-04-06","cited_by_count":43,"area":null},{"id":"2312.06205","title":"The Journey, Not the Destination: How Data Guides Diffusion Models","created":"2023-12-11","cited_by_count":43,"area":"diffusion"},{"id":"2406.06158","title":"Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning","created":"2024-06-10","cited_by_count":42,"area":null},{"id":"2305.18411","title":"Feature-Learning Networks Are Consistent Across Widths At Realistic Scales","created":"2023-05-28","cited_by_count":41,"area":null},{"id":"2405.15459","title":"Repetita Iuvant: Data Repetition Allows SGD to Learn High-Dimensional Multi-Index Functions","created":"2024-05-24","cited_by_count":37,"area":null},{"id":"2303.15438","title":"On the Stepwise Nature of Self-Supervised Learning","created":"2023-03-27","cited_by_count":36,"area":null},{"id":"2206.10012","title":"Limitations of the NTK for Understanding Generalization in Deep Learning","created":"2022-06-20","cited_by_count":35,"area":null},{"id":"2306.04815","title":"Catapults in SGD: spikes in the training loss and their impact on generalization through feature learning","created":"2023-06-07","cited_by_count":31,"area":null},{"id":"2211.06506","title":"Spectral Evolution and Invariance in Linear-width Neural Networks","created":"2022-11-11","cited_by_count":30,"area":null},{"id":"2604.21691","title":"There Will Be a Scientific Theory of Deep Learning","created":"2026-04-23","cited_by_count":29,"area":null},{"id":"2212.12147","title":"The Onset of Variance-Limited Behavior for Networks in the Lazy and Rich Regimes","created":"2022-12-23","cited_by_count":25,"area":null},{"id":"2212.13881","title":"Mechanism of feature learning in deep fully connected networks and kernel machines that recursively learn features","created":"2022-12-28","cited_by_count":25,"area":null},{"id":"2210.05577","title":"What Can the Neural Tangent Kernel Tell Us About Adversarial Robustness?","created":"2022-10-11","cited_by_count":21,"area":null},{"id":"2510.19093","title":"Weight Decay may matter more than muP for Learning Rate Transfer in Practice","created":"2025-10-21","cited_by_count":20,"area":null},{"id":"2210.02157","title":"The Influence of Learning Rule on Representation Dynamics in Wide Neural Networks","created":"2022-10-05","cited_by_count":19,"area":null},{"id":"2312.00935","title":"Understanding Unimodal Bias in Multimodal Deep Linear Networks","created":"2023-12-01","cited_by_count":19,"area":null},{"id":"2502.02531","title":"Deep Linear Network Training Dynamics from Random Initialization: Data, Width, Depth, and Hyperparameter Transfer","created":"2025-02-04","cited_by_count":19,"area":null},{"id":"2305.16427","title":"Neural (Tangent Kernel) Collapse","created":"2023-05-25","cited_by_count":18,"area":null},{"id":"2305.18512","title":"A Rainbow in Deep Network Black Boxes","created":"2023-05-29","cited_by_count":18,"area":null},{"id":"2510.01098","title":"Theory of Scaling Laws for In-Context Regression: Depth, Width, Context and Time","created":"2025-10-01","cited_by_count":16,"area":null},{"id":"2310.08513","title":"How connectivity structure shapes rich and lazy learning in neural circuits","created":"2023-10-12","cited_by_count":15,"area":null},{"id":"2512.20607","title":"Saddle-to-Saddle Dynamics Explains A Simplicity Bias Across Neural Network Architectures","created":"2025-12-23","cited_by_count":15,"area":null},{"id":"2210.12030","title":"Evolution of Neural Tangent Kernels under Benign and Adversarial Training","created":"2022-10-21","cited_by_count":14,"area":null},{"id":"2407.10315","title":"Order parameters and phase transitions of continual learning in deep neural networks","created":"2024-07-14","cited_by_count":14,"area":null},{"id":"2506.06489","title":"Alternating Gradient Flows: A Theory of Feature Learning in Two-layer Neural Networks","created":"2025-06-06","cited_by_count":14,"area":null},{"id":"2607.21716","title":"A Defense of the Quadratic Model","created":"2026-07-23","cited_by_count":14,"area":null},{"id":"2403.14917","title":"Mean-field Analysis on Two-layer Neural Networks from a Kernel Perspective","created":"2024-03-22","cited_by_count":13,"area":null},{"id":"2410.04642","title":"The Optimization Landscape of SGD Across the Feature Learning Strength","created":"2024-10-06","cited_by_count":13,"area":null},{"id":"2410.08194","title":"Features are fate: a theory of transfer learning in high-dimensional regression","created":"2024-10-10","cited_by_count":13,"area":null},{"id":"2502.07998","title":"Adaptive kernel predictors from feature-learning infinite limits of neural networks","created":"2025-02-11","cited_by_count":13,"area":null},{"id":"2409.13904","title":"High-dimensional learning of narrow neural networks","created":"2024-09-20","cited_by_count":12,"area":null},{"id":"2502.05300","title":"Parameter Symmetry Potentially Unifies Deep Learning Theory","created":"2025-02-07","cited_by_count":12,"area":null},{"id":"2206.02927","title":"Spectral Bias Outside the Training Set for Deep Networks in the Kernel Regime","created":"2022-06-06","cited_by_count":11,"area":null},{"id":"2206.11124","title":"A view of mini-batch SGD via generating functions: conditions of convergence, phase transitions, benefit from negative momenta","created":"2022-06-22","cited_by_count":11,"area":null},{"id":"2311.18718","title":"The Feature Speed Formula: a flexible approach to scale hyper-parameters of deep neural networks","created":"2023-11-30","cited_by_count":11,"area":null},{"id":"2402.09226","title":"Directional Convergence Near Small Initializations and Saddles in Two-Homogeneous Neural Networks","created":"2024-02-14","cited_by_count":11,"area":null},{"id":"2410.02348","title":"Simplicity bias and optimization threshold in two-layer ReLU networks","created":"2024-10-03","cited_by_count":11,"area":null},{"id":"2205.11006","title":"Nonparametric learning of kernels in nonlocal operators","created":"2022-05-23","cited_by_count":10,"area":null},{"id":"2602.03685","title":"Universal One-third Time Scaling in Learning Peaked Distributions","created":"2026-02-03","cited_by_count":10,"area":null},{"id":"2603.00742","title":"To Use or not to Use Muon: How Simplicity Bias in Optimizers Matters","created":"2026-02-28","cited_by_count":10,"area":null},{"id":"2202.00992","title":"Tight Convergence Rate Bounds for Optimization Under Power Law Spectral Conditions","created":"2022-02-02","cited_by_count":9,"area":null},{"id":"2502.09863","title":"Closed-Form Training Dynamics Reveal Learned Features and Linear Structure in Word2Vec-like Models","created":"2025-02-14","cited_by_count":8,"area":null},{"id":"2111.11954","title":"Depth induces scale-averaging in overparameterized linear Bayesian neural networks","created":"2021-11-23","cited_by_count":7,"area":null},{"id":"2303.02034","title":"Linear CNNs Discover the Statistical Structure of the Dataset Using Only the Most Dominant Frequencies","created":"2023-03-03","cited_by_count":7,"area":null},{"id":"2403.08121","title":"Early Directional Convergence in Deep Homogeneous Neural Networks for Small Initializations","created":"2024-03-12","cited_by_count":7,"area":null},{"id":"2606.22019","title":"Channel Location Constrains the Auditability of Subliminal Learning","created":"2026-06-20","cited_by_count":7,"area":null},{"id":"2401.13558","title":"Task structure and nonlinearity jointly determine learned representational geometry","created":"2024-01-24","cited_by_count":6,"area":null},{"id":"2502.18710","title":"Bridging Critical Gaps in Convergent Learning: How Representational Alignment Evolves Across Layers, Training, and Distribution Shifts","created":"2025-02-26","cited_by_count":6,"area":null},{"id":"2503.02526","title":"A Theory of Initialisation's Impact on Specialisation","created":"2025-03-04","cited_by_count":6,"area":null},{"id":"2507.12837","title":"Understanding the Evolution of the Neural Tangent Kernel at the Edge of Stability","created":"2025-07-17","cited_by_count":6,"area":null},{"id":"2602.20062","title":"A Theory of How Pretraining Shapes Inductive Bias in Fine-Tuning","created":"2026-02-23","cited_by_count":5,"area":null},{"id":"2401.07085","title":"Three Mechanisms of Feature Learning in a Linear Network","created":"2024-01-13","cited_by_count":4,"area":null},{"id":"2406.12615","title":"When Are Bias-Free ReLU Networks Effectively Linear Networks?","created":"2024-06-18","cited_by_count":4,"area":null},{"id":"2510.00468","title":"Feature Identification via the Empirical NTK","created":"2025-10-01","cited_by_count":4,"area":null},{"id":"2603.29805","title":"From Density Matrices to Phase Transitions in Deep Learning: Spectral Early Warnings and Interpretability","created":"2026-03-31","cited_by_count":4,"area":null},{"id":"2407.09845","title":"Towards Understanding Epoch-wise Double descent in Two-layer Linear Neural Networks","created":"2024-07-13","cited_by_count":3,"area":null},{"id":"2410.07451","title":"Collective variables of neural networks: empirical time evolution and scaling laws","created":"2024-10-09","cited_by_count":3,"area":null},{"id":"2511.10796","title":"Fast Generalized Neural Tangent Kernel Statistics via Trace Estimation","created":"2025-11-13","cited_by_count":3,"area":null},{"id":"2606.30509","title":"Muon learns balanced solutions in matrix factorization without slow saddle-to-saddle dynamics","created":"2026-06-29","cited_by_count":3,"area":null},{"id":"2209.01691","title":"On Kernel Regression with Data-Dependent Kernels","created":"2022-09-04","cited_by_count":2,"area":null},{"id":"2410.04228","title":"SGD with memory: fundamental properties and stochastic acceleration","created":"2024-10-05","cited_by_count":2,"area":null},{"id":"2410.04264","title":"Decoupling Dynamical Richness from Representation Learning: Towards Practical Measurement","created":"2024-10-05","cited_by_count":2,"area":null},{"id":"2410.12025","title":"Geometric Inductive Biases of Deep Networks: The Role of Data and Architecture","created":"2024-10-15","cited_by_count":2,"area":null},{"id":"2411.03840","title":"Flexible task abstractions emerge in linear networks with fast and bounded units","created":"2024-11-06","cited_by_count":2,"area":null},{"id":"2503.06181","title":"Make Haste Slowly: A Theory of Emergent Structured Mixed Selectivity in Feature Learning ReLU Networks","created":"2025-03-08","cited_by_count":2,"area":null},{"id":"2505.16017","title":"GradPCA: Leveraging NTK Alignment for Reliable Out-of-Distribution Detection","created":"2025-05-21","cited_by_count":2,"area":null},{"id":"2507.05035","title":"Beyond Scaling Curves: Internal Dynamics of Neural Networks Through the NTK Lens","created":"2025-07-07","cited_by_count":2,"area":null},{"id":"2512.22088","title":"Unifying Learning Dynamics and Generalization in Transformers Scaling Law","created":"2025-12-26","cited_by_count":2,"area":null},{"id":"2601.06961","title":"The Impact of Anisotropic Covariance Structure on the Training Dynamics and Generalization Error of Linear Networks","created":"2026-01-11","cited_by_count":2,"area":null},{"id":"2602.15593","title":"A unified theory of feature learning in RNNs and DNNs","created":"2026-02-17","cited_by_count":2,"area":null},{"id":"2308.15478","title":"An Adaptive Tangent Feature Perspective of Neural Networks","created":"2023-08-29","cited_by_count":1,"area":null},{"id":"2407.18807","title":"When narrower is better: the narrow width limit of Bayesian parallel branching neural networks","created":"2024-07-26","cited_by_count":1,"area":null},{"id":"2504.12519","title":"Corner Gradient Descent","created":"2025-04-16","cited_by_count":1,"area":null},{"id":"2505.16260","title":"Small-to-Large Generalization: Data Influences Models Consistently Across Scale","created":"2025-05-22","cited_by_count":1,"area":null},{"id":"2602.04832","title":"It's Not a Lottery, It's a Race: Understanding How Gradient Descent Adapts the Network's Capacity to the Task","created":"2026-02-04","cited_by_count":1,"area":null},{"id":"2605.02798","title":"Measuring Accuracy and Energy-to-Solution of Quantum Fine-Tuning of Foundational AI Models","created":"2026-05-04","cited_by_count":1,"area":null},{"id":"2605.31244","title":"Spectral Reach: Understanding Neural Scaling as Progress into the Spectral Tail","created":"2026-05-29","cited_by_count":1,"area":null},{"id":"2608.06766","title":"Hidden Gauge Controls Feature Specialization in ReLU Networks","created":"2026-08-07","cited_by_count":1,"area":null},{"id":"2312.02236","title":"Rethinking Adversarial Training with Neural Tangent Kernel","created":"2023-12-04","cited_by_count":0,"area":null},{"id":"2401.10686","title":"Manipulating Sparse Double Descent","created":"2024-01-19","cited_by_count":0,"area":null},{"id":"2404.04312","title":"Half-Space Feature Learning in Neural Networks","created":"2024-04-05","cited_by_count":0,"area":null},{"id":"2412.18756","title":"Towards a Statistical Understanding of Neural Networks: Beyond the Neural Tangent Kernel Theories","created":"2024-12-25","cited_by_count":0,"area":null},{"id":"2503.10587","title":"The Spectral Bias of Shallow Neural Network Learning is Shaped by the Choice of Non-linearity","created":"2025-03-13","cited_by_count":0,"area":null},{"id":"2505.11347","title":"Training NTK to Generalize with KARE","created":"2025-05-16","cited_by_count":0,"area":null},{"id":"2506.02406","title":"Random at First, Fast at Last: NTK-Guided Fourier Pre-Processing for Tabular DL","created":"2025-06-03","cited_by_count":0,"area":null},{"id":"2509.04661","title":"Flexible inference for animal learning rules using neural networks","created":"2025-09-04","cited_by_count":0,"area":"deeprl"},{"id":"2602.00576","title":"Data Distribution as a Lever for Guiding Optimizers Toward Superior Generalization in LLMs","created":"2026-01-31","cited_by_count":0,"area":null},{"id":"2602.00827","title":"Over-Alignment vs Over-Fitting: The Role of Feature Learning Strength in Generalization","created":"2026-01-31","cited_by_count":0,"area":null},{"id":"2602.03066","title":"Shortcut Features as Top Eigenfunctions of NTK: A Linear Neural Network Case and More","created":"2026-02-03","cited_by_count":0,"area":null},{"id":"2604.05469","title":"Task Ecologies and the Evolution of World-Tracking Representations in Large Language Models","created":"2026-04-07","cited_by_count":0,"area":null}],"next_cursor":"100"}