{"total":164,"rows":[{"id":"2307.05782","title":"Large Language Models","created":"2023-07-11","cited_by_count":780,"area":null},{"id":"2205.10343","title":"Towards Understanding Grokking: An Effective Theory of Representation Learning","created":"2022-05-20","cited_by_count":230,"area":null},{"id":"2210.16859","title":"A Solvable Model of Neural Scaling Laws","created":"2022-10-30","cited_by_count":116,"area":null},{"id":"2402.01092","title":"A Dynamical Model of Neural Scaling Laws","created":"2024-02-02","cited_by_count":111,"area":null},{"id":"2205.09653","title":"Self-Consistent Dynamical Field Theory of Kernel Evolution in Wide Neural Networks","created":"2022-05-19","cited_by_count":105,"area":null},{"id":"2301.02679","title":"Grokking modular arithmetic","created":"2023-01-06","cited_by_count":83,"area":null},{"id":"2505.01618","title":"Don't be lazy: CompleteP enables compute-efficient deep transformers","created":"2025-05-02","cited_by_count":78,"area":null},{"id":"2112.15383","title":"Separation of Scales and a Thermodynamic Description of Feature Learning in Some CNNs","created":"2021-12-31","cited_by_count":53,"area":null},{"id":"2306.17759","title":"The Shaped Transformer: Attention Models in the Infinite Depth-and-Width Limit","created":"2023-06-30","cited_by_count":47,"area":null},{"id":"2406.09405","title":"Why Warmup the Learning Rate? Underlying Mechanisms and Improvements","created":"2024-06-13","cited_by_count":46,"area":null},{"id":"2107.01562","title":"Random Neural Networks in the Infinite Width Limit as Gaussian Processes","created":"2021-07-04","cited_by_count":44,"area":null},{"id":"2304.03408","title":"Dynamics of Finite Width Kernel and Prediction Fluctuations in Mean Field Neural Networks","created":"2023-04-06","cited_by_count":43,"area":null},{"id":"2206.02768","title":"The Neural Covariance SDE: Shaped Infinite Depth-and-Width Networks at Initialization","created":"2022-06-06","cited_by_count":41,"area":null},{"id":"2302.00375","title":"Bayes-optimal Learning of Deep Random Networks of Extensive-width","created":"2023-02-01","cited_by_count":41,"area":null},{"id":"2305.18411","title":"Feature-Learning Networks Are Consistent Across Widths At Realistic Scales","created":"2023-05-28","cited_by_count":41,"area":null},{"id":"2210.04860","title":"Second-order regression models exhibit progressive sharpening to the edge of stability","created":"2022-10-10","cited_by_count":40,"area":null},{"id":"2207.10430","title":"The Neural Race Reduction: Dynamics of Abstraction in Gated Networks","created":"2022-07-21","cited_by_count":37,"area":null},{"id":"2206.10012","title":"Limitations of the NTK for Understanding Generalization in Deep Learning","created":"2022-06-20","cited_by_count":35,"area":null},{"id":"2303.03428","title":"Towards provably efficient quantum algorithms for large-scale machine-learning models","created":"2023-03-06","cited_by_count":32,"area":null},{"id":"2401.11351","title":"A comprehensive review of Quantum Machine Learning: from NISQ to Fault Tolerance","created":"2024-01-21","cited_by_count":32,"area":null},{"id":"2203.02628","title":"Target Network and Truncation Overcome The Deadly Triad in $Q$-Learning","created":"2022-03-05","cited_by_count":31,"area":null},{"id":"2306.04815","title":"Catapults in SGD: spikes in the training loss and their impact on generalization through feature learning","created":"2023-06-07","cited_by_count":31,"area":null},{"id":"2203.07379","title":"Quantitative Gaussian Approximation of Randomly Initialized Deep Neural Networks","created":"2022-03-14","cited_by_count":25,"area":null},{"id":"2212.12147","title":"The Onset of Variance-Limited Behavior for Networks in the Lazy and Rich Regimes","created":"2022-12-23","cited_by_count":25,"area":null},{"id":"2212.13881","title":"Mechanism of feature learning in deep fully connected networks and kernel machines that recursively learn features","created":"2022-12-28","cited_by_count":25,"area":null},{"id":"2106.11299","title":"Boundary Graph Neural Networks for 3D Simulations","created":"2021-06-21","cited_by_count":24,"area":null},{"id":"2108.01403","title":"Nonperturbative renormalization for the neural network-QFT correspondence","created":"2021-08-03","cited_by_count":24,"area":null},{"id":"2109.13247","title":"The edge of chaos: quantum field theory and deep neural networks","created":"2021-09-27","cited_by_count":24,"area":null},{"id":"2203.00573","title":"Contrasting random and learned features in deep Bayesian linear regression","created":"2022-03-01","cited_by_count":24,"area":null},{"id":"2307.03223","title":"Neural Network Field Theories: Non-Gaussianity, Actions, and Locality","created":"2023-07-06","cited_by_count":22,"area":null},{"id":"2311.02076","title":"Universal Sharpness Dynamics in Neural Network Training: Fixed Point Analysis, Edge of Stability, and Route to Chaos","created":"2023-11-03","cited_by_count":22,"area":null},{"id":"2203.16711","title":"Analytic theory for the dynamics of wide quantum neural networks","created":"2022-03-30","cited_by_count":21,"area":null},{"id":"2212.14457","title":"Bayesian Interpolation with Deep Linear Networks","created":"2022-12-29","cited_by_count":21,"area":null},{"id":"2304.02034","title":"Effective Theory of Transformers at Initialization","created":"2023-04-04","cited_by_count":21,"area":null},{"id":"2112.05589","title":"Unified field theoretical approach to deep and recurrent neuronal networks","created":"2021-12-10","cited_by_count":20,"area":null},{"id":"2307.06092","title":"Quantitative CLTs in Deep Neural Networks","created":"2023-07-12","cited_by_count":20,"area":null},{"id":"2206.01342","title":"Understanding the Role of Nonlinearity in Training Dynamics of Contrastive Learning","created":"2022-06-02","cited_by_count":19,"area":null},{"id":"2210.04909","title":"Meta-Principled Family of Hyperparameter Scaling Strategies","created":"2022-10-10","cited_by_count":19,"area":null},{"id":"2302.12250","title":"Phase diagram of early training dynamics in deep neural networks: effect of the learning rate, depth, and width","created":"2023-02-23","cited_by_count":19,"area":null},{"id":"2307.11807","title":"Local Kernel Renormalization as a mechanism for feature learning in overparametrized Convolutional Neural Networks","created":"2023-07-21","cited_by_count":19,"area":null},{"id":"2401.00955","title":"Learning Long Sequences in Spiking Neural Networks","created":"2023-12-14","cited_by_count":19,"area":null},{"id":"2502.02531","title":"Deep Linear Network Training Dynamics from Random Initialization: Data, Width, Depth, and Hyperparameter Transfer","created":"2025-02-04","cited_by_count":19,"area":null},{"id":"2108.13097","title":"A theory of representation learning gives a deep generalisation of kernel methods","created":"2021-08-30","cited_by_count":15,"area":null},{"id":"2107.06898","title":"Towards quantifying information flows: relative entropy in deep neural networks and the renormalization group","created":"2021-07-14","cited_by_count":14,"area":null},{"id":"2210.12030","title":"Evolution of Neural Tangent Kernels under Benign and Adversarial Training","created":"2022-10-21","cited_by_count":14,"area":null},{"id":"2303.02165","title":"DeepMAD: Mathematical Architecture Design for Deep Convolutional Neural Network","created":"2023-03-05","cited_by_count":14,"area":null},{"id":"2305.02334","title":"Structures of Neural Network Effective Theories","created":"2023-05-03","cited_by_count":13,"area":null},{"id":"2306.01485","title":"Robust low-rank training via approximate orthonormal constraints","created":"2023-06-02","cited_by_count":13,"area":null},{"id":"2502.07998","title":"Adaptive kernel predictors from feature-learning infinite limits of neural networks","created":"2025-02-11","cited_by_count":13,"area":null},{"id":"2109.07573","title":"Differentiable Physics: A Position Piece","created":"2021-09-14","cited_by_count":12,"area":null},{"id":"2202.04925","title":"Decomposing neural networks as mappings of correlation functions","created":"2022-02-10","cited_by_count":12,"area":null},{"id":"2204.14126","title":"Wide and Deep Neural Networks Achieve Optimality for Classification","created":"2022-04-29","cited_by_count":12,"area":null},{"id":"2402.13321","title":"Rigor with Machine Learning from Field Theory to the Poincar\\'e Conjecture","created":"2024-02-20","cited_by_count":12,"area":null},{"id":"2207.04941","title":"Wavelet Conditional Renormalization Group","created":"2022-07-11","cited_by_count":11,"area":null},{"id":"2212.07295","title":"Maximal Initial Learning Rates in Deep ReLU Networks","created":"2022-12-14","cited_by_count":11,"area":null},{"id":"2406.16689","title":"Coding schemes in neural networks learning classification tasks","created":"2024-06-24","cited_by_count":11,"area":null},{"id":"2201.11137","title":"Born-Infeld (BI) for AI: Energy-Conserving Descent (ECD) for Optimization","created":"2022-01-26","cited_by_count":10,"area":null},{"id":"2202.11104","title":"A duality connecting neural network and cosmological dynamics","created":"2022-02-22","cited_by_count":10,"area":null},{"id":"2206.09313","title":"Laziness, Barren Plateau, and Noise in Machine Learning","created":"2022-06-19","cited_by_count":10,"area":null},{"id":"2502.03210","title":"From Kernels to Features: A Multi-Scale Adaptive Theory of Feature Learning","created":"2025-02-05","cited_by_count":10,"area":null},{"id":"2204.12939","title":"On the Dynamics of Inference and Learning","created":"2022-04-19","cited_by_count":9,"area":null},{"id":"2206.07673","title":"Wide Bayesian neural networks have a simple weight posterior: theory and accelerated sampling","created":"2022-06-15","cited_by_count":9,"area":null},{"id":"2402.05970","title":"Modeling Spatio-temporal Dynamical Systems with Neural Discrete Learning and Levels-of-Experts","created":"2024-02-06","cited_by_count":9,"area":null},{"id":"2403.20002","title":"Grounding and Enhancing Grid-based Models for Neural Fields","created":"2024-03-29","cited_by_count":9,"area":null},{"id":"2405.17538","title":"Bayesian RG Flow in Neural Network Field Theories","created":"2024-05-27","cited_by_count":9,"area":null},{"id":"2110.03210","title":"Universality of Winning Tickets: A Renormalization Group Perspective","created":"2021-10-07","cited_by_count":8,"area":null},{"id":"2111.12143","title":"Critical Initialization of Wide and Deep Neural Networks through Partial Jacobians: General Theory and Applications","created":"2021-11-23","cited_by_count":8,"area":null},{"id":"2301.07737","title":"Catapult Dynamics and Phase Transitions in Quadratic Nets","created":"2023-01-18","cited_by_count":8,"area":null},{"id":"2305.06472","title":"ChatGPT-Like Large-Scale Foundation Models for Prognostics and Health Management: A Survey and Roadmaps","created":"2023-05-10","cited_by_count":8,"area":null},{"id":"2306.16932","title":"A Quantitative Functional Central Limit Theorem for Shallow Neural Networks","created":"2023-06-29","cited_by_count":8,"area":null},{"id":"2111.11954","title":"Depth induces scale-averaging in overparameterized linear Bayesian neural networks","created":"2021-11-23","cited_by_count":7,"area":null},{"id":"2310.12802","title":"An effective theory of collective deep learning","created":"2023-10-19","cited_by_count":7,"area":null},{"id":"2407.04117","title":"Predictive Coding Networks and Inference Learning: Tutorial and Survey","created":"2024-07-04","cited_by_count":7,"area":null},{"id":"2206.14820","title":"Strong Lensing Source Reconstruction Using Continuous Neural Fields","created":"2022-06-29","cited_by_count":6,"area":null},{"id":"2212.00802","title":"An Introduction to Kernel and Operator Learning Methods for Homogenization by Self-consistent Clustering Analysis","created":"2022-12-01","cited_by_count":6,"area":null},{"id":"2312.02264","title":"Scaling Laws in Jet Classification","created":"2023-12-04","cited_by_count":6,"area":null},{"id":"2506.16884","title":"The Importance of Being Lazy: Scaling Limits of Continual Learning","created":"2025-06-20","cited_by_count":6,"area":null},{"id":"2511.16741","title":"Fermions and Supersymmetry in Neural Network Field Theories","created":"2025-11-20","cited_by_count":6,"area":null},{"id":"2208.06028","title":"Gaussian Process Surrogate Models for Neural Networks","created":"2022-08-11","cited_by_count":5,"area":null},{"id":"2208.09859","title":"Emergence of hierarchical modes from deep learning","created":"2022-08-21","cited_by_count":5,"area":null},{"id":"2210.16400","title":"Flatter, faster: scaling momentum for optimal speedup of SGD","created":"2022-10-28","cited_by_count":5,"area":null},{"id":"2307.01177","title":"Neural Hilbert Ladders: Multi-Layer Neural Networks in Function Space","created":"2023-07-03","cited_by_count":5,"area":null},{"id":"2310.02258","title":"A Neural Scaling Law from Lottery Ticket Ensembling","created":"2023-10-03","cited_by_count":5,"area":null},{"id":"2310.07765","title":"Feature Learning and Generalization in Deep Networks with Orthogonal Weights","created":"2023-10-11","cited_by_count":5,"area":null},{"id":"2402.16184","title":"Deep Neural Network Initialization with Sparsity Inducing Activations","created":"2024-02-25","cited_by_count":5,"area":null},{"id":"2405.19398","title":"Neural Scaling Laws From Large-N Field Theory: Solvable Model Beyond the Ridgeless Limit","created":"2024-05-29","cited_by_count":5,"area":null},{"id":"2112.00723","title":"Infinite Neural Network Quantum States: Entanglement and Training Dynamics","created":"2021-12-01","cited_by_count":4,"area":null},{"id":"2112.15577","title":"How Infinitely Wide Neural Networks Can Benefit from Multi-task Learning -- an Exact Macroscopic Characterization","created":"2021-12-31","cited_by_count":4,"area":null},{"id":"2201.10859","title":"Visualizing the Diversity of Representations Learned by Bayesian Neural Networks","created":"2022-01-26","cited_by_count":4,"area":null},{"id":"2202.01919","title":"Theoretical Exploration of Solutions of Feedforward ReLU Networks","created":"2022-01-24","cited_by_count":4,"area":null},{"id":"2211.17180","title":"Nonlinear Advantage: Trained Networks Might Not Be As Complex as You Think","created":"2022-11-30","cited_by_count":4,"area":null},{"id":"2212.11826","title":"The Quantum Path Kernel: a Generalized Quantum Neural Tangent Kernel for Deep Quantum Machine Learning","created":"2022-12-22","cited_by_count":4,"area":null},{"id":"2306.00352","title":"Improving Energy Conserving Descent for Machine Learning: Theory and Practice","created":"2023-06-01","cited_by_count":4,"area":null},{"id":"2307.02284","title":"Universal Scaling Laws of Absorbing Phase Transitions in Artificial Deep Neural Networks","created":"2023-07-05","cited_by_count":4,"area":null},{"id":"2307.09550","title":"The semantic landscape paradigm for neural networks","created":"2023-07-18","cited_by_count":4,"area":null},{"id":"2403.20284","title":"LayerNorm: A key component in parameter-efficient fine-tuning","created":"2024-03-29","cited_by_count":4,"area":null},{"id":"2510.00468","title":"Feature Identification via the Empirical NTK","created":"2025-10-01","cited_by_count":4,"area":null},{"id":"2206.13568","title":"AutoInit: Automatic Initialization via Jacobian Tuning","created":"2022-06-27","cited_by_count":3,"area":null},{"id":"2304.04784","title":"Criticality versus uniformity in deep neural networks","created":"2023-04-10","cited_by_count":3,"area":null},{"id":"2306.11668","title":"Principles for Initialization and Architecture Selection in Graph Neural Networks with ReLU Activations","created":"2023-06-20","cited_by_count":3,"area":null}],"next_cursor":"100"}