{"total":102,"rows":[{"id":"2402.11004","title":"The Evolution of Statistical Induction Heads: In-Context Learning Markov Chains","created":"2024-02-16","cited_by_count":118,"area":null},{"id":"2311.18817","title":"Dichotomy of Early and Late Phase Implicit Biases Can Provably Induce Grokking","created":"2023-11-30","cited_by_count":80,"area":null},{"id":"2501.04697","title":"Grokking at the Edge of Numerical Stability","created":"2025-01-08","cited_by_count":46,"area":null},{"id":"2406.06158","title":"Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning","created":"2024-06-10","cited_by_count":42,"area":null},{"id":"2407.12332","title":"Why Do You Grok? A Theoretical Analysis of Grokking Modular Addition","created":"2024-07-17","cited_by_count":36,"area":null},{"id":"2406.19370","title":"Emergence of Hidden Capabilities: Exploring Learning Dynamics in Concept Space","created":"2024-06-27","cited_by_count":35,"area":null},{"id":"2408.11804","title":"Approaching Deep Learning through the Spectral Dynamics of Weights","created":"2024-08-21","cited_by_count":31,"area":null},{"id":"2407.20199","title":"Emergence in non-neural models: grokking modular arithmetic via average gradient outer product","created":"2024-07-29","cited_by_count":28,"area":null},{"id":"2312.06581","title":"Grokking Group Multiplication with Cosets","created":"2023-12-11","cited_by_count":24,"area":null},{"id":"2408.08944","title":"Information-Theoretic Progress Measures reveal Grokking is an Emergent Phase Transition","created":"2024-08-16","cited_by_count":17,"area":null},{"id":"2402.01909","title":"On Catastrophic Inheritance of Large Foundation Models","created":"2024-02-02","cited_by_count":15,"area":null},{"id":"2509.21519","title":"Provable Scaling Laws of Feature Emergence from Learning Dynamics of Grokking","created":"2025-09-25","cited_by_count":15,"area":null},{"id":"2402.16726","title":"Towards Empirical Interpretation of Internal Circuits and Properties in Grokked Transformers on Modular Polynomials","created":"2024-02-26","cited_by_count":14,"area":null},{"id":"2410.04642","title":"The Optimization Landscape of SGD Across the Feature Learning Strength","created":"2024-10-06","cited_by_count":13,"area":null},{"id":"2503.10065","title":"Do We Always Need the Simplicity Bias? Looking for Optimal Inductive Biases in the Wild","created":"2025-03-13","cited_by_count":13,"area":null},{"id":"2504.13292","title":"Let Me Grok for You: Accelerating Grokking via Embedding Transfer from a Weaker Model","created":"2025-04-17","cited_by_count":13,"area":null},{"id":"2505.20172","title":"A Theoretical Framework for Grokking: Interpolation followed by Riemannian Norm Minimisation","created":"2025-05-26","cited_by_count":13,"area":null},{"id":"2406.04425","title":"On Regularization via Early Stopping for Least Squares Regression","created":"2024-06-06","cited_by_count":11,"area":null},{"id":"2602.16746","title":"Low-Dimensional and Transversely Curved Optimization Dynamics in Grokking","created":"2026-02-18","cited_by_count":11,"area":null},{"id":"2605.29548","title":"Why Larger Models Learn More: Effects of Capacity, Interference, and Rare-Task Retention","created":"2026-05-28","cited_by_count":10,"area":null},{"id":"2411.00247","title":"Deep Learning Through A Telescoping Lens: A Simple Model Provides Empirical Insights On Grokking, Gradient Boosting & Beyond","created":"2024-10-31","cited_by_count":9,"area":null},{"id":"2502.21009","title":"Position: Solve Layerwise Linear Models First to Understand Neural Dynamical Phenomena (Neural Collapse, Emergence, Lazy/Rich Regime, and Grokking)","created":"2025-02-28","cited_by_count":9,"area":null},{"id":"2503.18114","title":"Feature Learning beyond the Lazy-Rich Dichotomy: Insights from Representational Geometry","created":"2025-03-23","cited_by_count":9,"area":null},{"id":"2602.18523","title":"The Geometry of Multi-Task Grokking: Transverse Instability, Superposition, and Weight Decay Phase Structure","created":"2026-02-19","cited_by_count":9,"area":null},{"id":"2505.11411","title":"Is Grokking a Computational Glass Relaxation?","created":"2025-05-16","cited_by_count":8,"area":null},{"id":"2507.20057","title":"What Can Grokking Teach Us About Learning Under Nonstationarity?","created":"2025-07-26","cited_by_count":8,"area":null},{"id":"2509.17196","title":"Evolution of Concepts in Language Model Pre-Training","created":"2025-09-21","cited_by_count":8,"area":null},{"id":"2509.17738","title":"Flatness is Necessary, Neural Collapse is Not: Rethinking Generalization via Grokking","created":"2025-09-22","cited_by_count":8,"area":null},{"id":"2601.19791","title":"To Grok Grokking: Provable Grokking in Ridge Regression","created":"2026-01-27","cited_by_count":8,"area":null},{"id":"2506.13688","title":"What Happens During the Loss Plateau? Understanding Abrupt Learning in Transformers","created":"2025-06-16","cited_by_count":7,"area":null},{"id":"2310.19470","title":"Bridging Lottery Ticket and Grokking: Understanding Grokking from Inner Structure of Networks","created":"2023-10-30","cited_by_count":6,"area":null},{"id":"2505.15624","title":"Mechanistic Insights into Grokking from the Embedding Layer","created":"2025-05-21","cited_by_count":6,"area":null},{"id":"2506.16884","title":"The Importance of Being Lazy: Scaling Limits of Continual Learning","created":"2025-06-20","cited_by_count":6,"area":null},{"id":"2603.25009","title":"A Systematic Empirical Study of Grokking: Depth, Architecture, Activation, and Regularization","created":"2026-03-26","cited_by_count":6,"area":null},{"id":"2402.03579","title":"Deconstructing the Goldilocks Zone of Neural Network Initialization","created":"2024-02-05","cited_by_count":4,"area":null},{"id":"2509.06931","title":"Learning words in groups: fusion algebras, tensor ranks and grokking","created":"2025-09-08","cited_by_count":4,"area":null},{"id":"2509.20829","title":"Explaining Grokking and Information Bottleneck through Neural Collapse Emergence","created":"2025-09-25","cited_by_count":4,"area":null},{"id":"2603.01192","title":"A Basin-Selection Perspective on Grokking via Singular Learning Theory","created":"2026-03-01","cited_by_count":4,"area":null},{"id":"2603.03415","title":"Farther the Shift, Sparser the Representation: Analyzing OOD Mechanisms in LLMs","created":"2026-03-03","cited_by_count":4,"area":null},{"id":"2603.29805","title":"From Density Matrices to Phase Transitions in Deep Learning: Spectral Early Warnings and Interpretability","created":"2026-03-31","cited_by_count":4,"area":null},{"id":"2605.06152","title":"Grokking or Glitching? How Low-Precision Drives Slingshot Loss Spikes","created":"2026-05-07","cited_by_count":4,"area":null},{"id":"2605.09724","title":"Model Capacity Determines Grokking through Competing Memorisation and Generalisation Speeds","created":"2026-05-10","cited_by_count":4,"area":null},{"id":"2606.13753","title":"The Weight Norm Sets the Grokking Timescale: A Causal Delay Law","created":"2026-06-11","cited_by_count":4,"area":null},{"id":"2405.17479","title":"A rationale from frequency perspective for grokking in training neural network","created":"2024-05-24","cited_by_count":3,"area":null},{"id":"2506.23286","title":"Not All Explanations for Deep Learning Phenomena Are Equally Valuable","created":"2025-06-29","cited_by_count":3,"area":null},{"id":"2507.04448","title":"Transfer Learning in Infinite Width Feature Learning Networks","created":"2025-07-06","cited_by_count":3,"area":null},{"id":"2511.10796","title":"Fast Generalized Neural Tangent Kernel Statistics via Trace Estimation","created":"2025-11-13","cited_by_count":3,"area":null},{"id":"2602.05184","title":"Towards Worst-Case Guarantees with Scale-Aware Interpretability","created":"2026-02-05","cited_by_count":3,"area":null},{"id":"2604.13082","title":"The Long Delay to Arithmetic Generalization: When Learned Representations Outrun Behavior","created":"2026-03-30","cited_by_count":3,"area":null},{"id":"2410.04264","title":"Decoupling Dynamical Richness from Representation Learning: Towards Practical Measurement","created":"2024-10-05","cited_by_count":2,"area":null},{"id":"2502.01739","title":"Grokking vs. Learning: Same Features, Different Encodings","created":"2025-02-03","cited_by_count":2,"area":null},{"id":"2504.17243","title":"NeuralGrok: Accelerate Grokking by Neural Gradient Transformation","created":"2025-04-24","cited_by_count":2,"area":null},{"id":"2506.12284","title":"GrokAlign: Geometric Characterisation and Acceleration of Grokking","created":"2025-06-14","cited_by_count":2,"area":null},{"id":"2507.05387","title":"The Generalization Ridge: Information Flow in Natural Language Generation","created":"2025-07-07","cited_by_count":2,"area":null},{"id":"2507.05644","title":"The Features at Convergence Theorem: a first-principles alternative to the Neural Feature Ansatz for how networks learn representations","created":"2025-07-08","cited_by_count":2,"area":null},{"id":"2510.01930","title":"Precise Dynamics of Diagonal Linear Networks: A Unifying Analysis by Dynamical Mean-Field Theory","created":"2025-10-02","cited_by_count":2,"area":null},{"id":"2510.04930","title":"Egalitarian Gradient Descent: A Simple Approach to Accelerated Grokking","created":"2025-10-06","cited_by_count":2,"area":null},{"id":"2602.06702","title":"Explaining Grokking in Transformers through the Lens of Inductive Bias","created":"2026-02-06","cited_by_count":2,"area":null},{"id":"2602.19533","title":"Grokking Finite-Dimensional Algebra","created":"2026-02-23","cited_by_count":2,"area":null},{"id":"2604.13123","title":"Spectral Entropy Collapse as a Phase Transition in Delayed Generalisation: An Interventional and Predictive Framework for Grokkin","created":"2026-04-13","cited_by_count":2,"area":null},{"id":"2605.20441","title":"Weight Decay Regimes in Grokking Transformers: Cheap Online Diagnostics","created":"2026-05-19","cited_by_count":2,"area":null},{"id":"2606.12966","title":"Learned Structure Shows Up Earlier in the Task's Own Basis: A Controlled Look at a Synchronisation Precursor in Grokking","created":"2026-06-11","cited_by_count":2,"area":null},{"id":"2607.13749","title":"Algebraic Representability as the Limiting Regime of Grokking: An Exactly Solvable Model with Holomorphic Activations","created":"2026-07-15","cited_by_count":2,"area":null},{"id":"2607.23967","title":"Grokking on the Weight-Decay Clock: A Rate Hierarchy from Softly Broken Symmetries","created":"2026-07-27","cited_by_count":2,"area":null},{"id":"2502.01774","title":"Grokking Explained: A Statistical Phenomenon","created":"2025-02-03","cited_by_count":1,"area":null},{"id":"2511.04760","title":"When Data Falls Short: Grokking Below the Critical Threshold","created":"2025-11-06","cited_by_count":1,"area":null},{"id":"2601.03162","title":"On the Convergence Behavior of Preconditioned Gradient Descent Toward the Rich Learning Regime","created":"2026-01-06","cited_by_count":1,"area":null},{"id":"2602.08302","title":"On the Dynamics of Delayed Generalization in Linear Models","created":"2026-02-09","cited_by_count":1,"area":null},{"id":"2603.15492","title":"Grokking as a Variance-Limited Phase Transition: Spectral Gating and the Epsilon-Stability Threshold","created":"2026-03-16","cited_by_count":1,"area":null},{"id":"2604.00316","title":"Breaking Data Symmetry is Needed For Generalization in Feature Learning Kernels","created":"2026-03-31","cited_by_count":1,"area":null},{"id":"2605.15787","title":"Grokking as Structural Inference: Transformers Need Bayesian Lottery Tickets","created":"2026-05-15","cited_by_count":1,"area":null},{"id":"2605.18845","title":"First-Passage Prediction of Grokking Delay: ACalibrated Law under AdamW with Causal Validation","created":"2026-05-13","cited_by_count":1,"area":null},{"id":"2606.05863","title":"Deciphering Two Training Clocks in Grokking via Deep Linear Network Theory with Conditional ReLU Reduction","created":"2026-06-04","cited_by_count":1,"area":null},{"id":"2606.18465","title":"What Does the Weight Norm Control in Grokking? Logit-Scale Mediation under Cross-Entropy","created":"2026-06-16","cited_by_count":1,"area":null},{"id":"2607.04135","title":"Broken Ergodicity and the Violation of the Fluctuation-Dissipation Theorem Lead to Generalization Beyond Overfitting in Machine Learning","created":"2026-07-05","cited_by_count":1,"area":null},{"id":"2607.06639","title":"At-Grok Is Not Converged:A Measurement-Validity Audit for Grokking Representation Metrics","created":"2026-07-07","cited_by_count":1,"area":null},{"id":"2608.01833","title":"Tunneling the Loss Landscape: Bypassing Memorization with Monte Carlo Parameter Swapping","created":"2026-08-03","cited_by_count":1,"area":null},{"id":"2608.22513","title":"From Symmetry to Invariance: Learning Galois Equivalent Representations in Finite Fields","created":"2026-08-23","cited_by_count":1,"area":null},{"id":"2608.25813","title":"Mapping the Emergence of Regularization-Driven Dynamics in Grokking","created":"2026-08-26","cited_by_count":1,"area":null},{"id":"2403.05532","title":"Twin: Tuning Learning Rate and Weight Decay of Deep Homogeneous Classifiers without Validation","created":"2024-03-08","cited_by_count":0,"area":null},{"id":"2405.15135","title":"Neural Surveillance: Live-Update Visualization of Latent Training Dynamics","created":"2024-05-24","cited_by_count":0,"area":null},{"id":"2407.06765","title":"A Generalization Bound for Nearly-Linear Networks","created":"2024-07-09","cited_by_count":0,"area":null},{"id":"2410.03972","title":"Measuring and Controlling Solution Degeneracy across Task-Trained Recurrent Neural Networks","created":"2024-10-04","cited_by_count":0,"area":null},{"id":"2411.03541","title":"Do Mice Grok? Glimpses of Hidden Progress During Overtraining in Sensory Cortex","created":"2024-11-05","cited_by_count":0,"area":null},{"id":"2507.01414","title":"Decomposing Prediction Mechanisms for In-Context Recall","created":"2025-07-02","cited_by_count":0,"area":null},{"id":"2507.11645","title":"Tracing the Path to Grokking: Embeddings, Dropout, and Network Activation","created":"2025-07-15","cited_by_count":0,"area":null},{"id":"2510.20190","title":"The Lock-In Phase Hypothesis: Identity Consolidation as a Precursor to AGI","created":"2025-10-23","cited_by_count":0,"area":null},{"id":"2512.18471","title":"The Urysohn Ladder: Recursive Metric Contraction for Scalable Continual Learning","created":"2025-12-20","cited_by_count":0,"area":null},{"id":"2604.06366","title":"Stochastic Gradient Descent in the Saddle-to-Saddle Regime of Deep Linear Networks","created":"2026-04-07","cited_by_count":0,"area":null},{"id":"2605.08119","title":"Feature Repulsion and Spectral Lock-in: An Empirical Study of Two-Layer Network Grokking","created":"2026-04-28","cited_by_count":0,"area":null},{"id":"2605.08464","title":"The Geometric Structure of Models Learning Sparse Data","created":"2026-05-08","cited_by_count":0,"area":null},{"id":"2606.01521","title":"Fast Generalization after Interpolation via Critically Damped Momentum Optimization","created":"2026-06-01","cited_by_count":0,"area":null},{"id":"2606.29679","title":"Learning as Observable Matrix Dynamics: Diffusive Relaxations versus Phase Transitions","created":"2026-06-29","cited_by_count":0,"area":null},{"id":"2607.05113","title":"Rating the Pitch, Not the Product: User Evaluations of LLMs Reflect Expectations More Than Performance","created":"2026-07-06","cited_by_count":0,"area":null},{"id":"2608.28948","title":"From the Loss Landscape to Diverse Feature Learning in Neural Networks","created":"2026-08-28","cited_by_count":0,"area":null},{"id":"2609.15047","title":"Structured Features Overfit Where Random Features Grok","created":"2026-09-14","cited_by_count":0,"area":null},{"id":"2609.18078","title":"Beyond Embedding Transfer: Component Roles in Grokking Transfer and Stability","created":"2026-09-16","cited_by_count":0,"area":null},{"id":"2609.20166","title":"Small Enough to Know Everything: The Fully-Enumerable Transformer as an Instrument for the Science of Delayed Generalization","created":"2026-08-03","cited_by_count":0,"area":null},{"id":"2609.26679","title":"A Spectral Theory of Grokking: Weight Decay induces Feature Learning","created":"2026-09-22","cited_by_count":0,"area":null},{"id":"2609.35288","title":"$\\lambda$-JEPA Spectral Anti-Collapse Regularization for Self-Supervised Learning","created":"2026-09-28","cited_by_count":0,"area":null}],"next_cursor":"100"}