{"total":133,"rows":[{"id":"2304.15004","title":"Are Emergent Abilities of Large Language Models a Mirage?","created":"2023-04-28","cited_by_count":523,"area":null},{"id":"2306.17844","title":"The Clock and the Pizza: Two Stories in Mechanistic Explanation of Neural Networks","created":"2023-06-30","cited_by_count":156,"area":null},{"id":"2309.07311","title":"Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs","created":"2023-09-13","cited_by_count":124,"area":null},{"id":"2309.02390","title":"Explaining grokking through circuit efficiency","created":"2023-09-05","cited_by_count":111,"area":null},{"id":"2310.06110","title":"Grokking as the Transition from Lazy to Rich Training Dynamics","created":"2023-10-09","cited_by_count":108,"area":null},{"id":"2301.02679","title":"Grokking modular arithmetic","created":"2023-01-06","cited_by_count":83,"area":null},{"id":"2303.11873","title":"A Tale of Two Circuits: Grokking as Competition of Sparse and Dense Subnetworks","created":"2023-03-21","cited_by_count":83,"area":null},{"id":"2311.18817","title":"Dichotomy of Early and Late Phase Implicit Biases Can Provably Induce Grokking","created":"2023-11-30","cited_by_count":80,"area":null},{"id":"2305.18741","title":"Grokking of Hierarchical Structure in Vanilla Transformers","created":"2023-05-30","cited_by_count":53,"area":null},{"id":"2310.03789","title":"Grokking as a First Order Phase Transition in Two Layer Networks","created":"2023-10-05","cited_by_count":48,"area":null},{"id":"2501.04697","title":"Grokking at the Edge of Numerical Stability","created":"2025-01-08","cited_by_count":46,"area":null},{"id":"2405.20233","title":"Grokfast: Accelerated Grokking by Amplifying Slow Gradients","created":"2024-05-30","cited_by_count":41,"area":null},{"id":"2407.12332","title":"Why Do You Grok? A Theoretical Analysis of Grokking Modular Addition","created":"2024-07-17","cited_by_count":36,"area":null},{"id":"2406.19370","title":"Emergence of Hidden Capabilities: Exploring Learning Dynamics in Concept Space","created":"2024-06-27","cited_by_count":35,"area":null},{"id":"2310.02541","title":"Benign Overfitting and Grokking in ReLU Networks for XOR Cluster Data","created":"2023-10-04","cited_by_count":33,"area":null},{"id":"2311.07568","title":"Feature emergence via margin maximization: case studies in algebraic tasks","created":"2023-11-13","cited_by_count":33,"area":null},{"id":"2407.20199","title":"Emergence in non-neural models: grokking modular arithmetic via average gradient outer product","created":"2024-07-29","cited_by_count":28,"area":null},{"id":"2408.09503","title":"Out-of-distribution generalization via composition: a lens through induction heads in Transformers","created":"2024-08-18","cited_by_count":28,"area":null},{"id":"2310.13061","title":"To grok or not to grok: Disentangling generalization and memorization on corrupted algorithmic datasets","created":"2023-10-19","cited_by_count":24,"area":null},{"id":"2509.21016","title":"RL Grokking Recipe: How Does RL Unlock and Transfer New Algorithms in LLMs?","created":"2025-09-25","cited_by_count":23,"area":null},{"id":"2505.11581","title":"Questioning Representational Optimism in Deep Learning: The Fractured Entangled Representation Hypothesis","created":"2025-05-16","cited_by_count":22,"area":null},{"id":"2501.08537","title":"Complexity Control Facilitates Reasoning-Based Compositional Generalization in Transformers","created":"2025-01-15","cited_by_count":20,"area":null},{"id":"2406.03495","title":"Grokking Modular Polynomials","created":"2024-06-05","cited_by_count":18,"area":null},{"id":"2405.05409","title":"Initialization is Critical to Whether Transformers Fit Composite Functions by Reasoning or Memorizing","created":"2024-05-08","cited_by_count":17,"area":null},{"id":"2308.09543","title":"Latent State Models of Training Dynamics","created":"2023-08-18","cited_by_count":16,"area":null},{"id":"2509.21519","title":"Provable Scaling Laws of Feature Emergence from Learning Dynamics of Grokking","created":"2025-09-25","cited_by_count":15,"area":null},{"id":"2310.05918","title":"Grokking as Compression: A Nonlinear Complexity Perspective","created":"2023-10-09","cited_by_count":14,"area":null},{"id":"2310.12956","title":"Eureka-Moments in Transformers: Multi-Step Tasks Reveal Softmax Induced Optimization Problems","created":"2023-10-19","cited_by_count":14,"area":null},{"id":"2402.16726","title":"Towards Empirical Interpretation of Internal Circuits and Properties in Grokked Transformers on Modular Polynomials","created":"2024-02-26","cited_by_count":14,"area":null},{"id":"2502.02496","title":"Deep Weight Factorization: Sparse Learning Through the Lens of Artificial Symmetries","created":"2025-02-04","cited_by_count":14,"area":null},{"id":"2309.03800","title":"Pareto Frontiers in Neural Feature Learning: Data, Compute, Width, and Luck","created":"2023-09-07","cited_by_count":13,"area":null},{"id":"2310.17247","title":"Grokking Beyond Neural Networks: An Empirical Exploration with Model Complexity","created":"2023-10-26","cited_by_count":13,"area":null},{"id":"2504.13292","title":"Let Me Grok for You: Accelerating Grokking via Embedding Transfer from a Weaker Model","created":"2025-04-17","cited_by_count":13,"area":null},{"id":"2505.20172","title":"A Theoretical Framework for Grokking: Interpolation followed by Riemannian Norm Minimisation","created":"2025-05-26","cited_by_count":13,"area":null},{"id":"2311.06597","title":"Understanding Grokking Through A Robustness Viewpoint","created":"2023-11-11","cited_by_count":12,"area":null},{"id":"2410.07041","title":"Emergent properties with repeated examples","created":"2024-10-09","cited_by_count":11,"area":null},{"id":"2410.22244","title":"Abrupt Learning in Transformers: A Case Study on Matrix Completion","created":"2024-10-29","cited_by_count":11,"area":null},{"id":"2602.16746","title":"Low-Dimensional and Transversely Curved Optimization Dynamics in Grokking","created":"2026-02-18","cited_by_count":11,"area":null},{"id":"2302.09160","title":"Identifying Equivalent Training Dynamics","created":"2023-02-17","cited_by_count":9,"area":null},{"id":"2411.00247","title":"Deep Learning Through A Telescoping Lens: A Simple Model Provides Empirical Insights On Grokking, Gradient Boosting & Beyond","created":"2024-10-31","cited_by_count":9,"area":null},{"id":"2511.01938","title":"The Geometry of Grokking: Norm Minimization on the Zero-Loss Manifold","created":"2025-11-02","cited_by_count":9,"area":null},{"id":"2602.18523","title":"The Geometry of Multi-Task Grokking: Transverse Instability, Superposition, and Weight Decay Phase Structure","created":"2026-02-19","cited_by_count":9,"area":null},{"id":"2405.12755","title":"Progress Measures for Grokking on Real-world Tasks","created":"2024-05-21","cited_by_count":8,"area":null},{"id":"2501.12391","title":"Physics of Skill Learning","created":"2025-01-21","cited_by_count":8,"area":null},{"id":"2505.11411","title":"Is Grokking a Computational Glass Relaxation?","created":"2025-05-16","cited_by_count":8,"area":null},{"id":"2507.08017","title":"Mechanistic Indicators of Understanding in Large Language Models","created":"2025-07-07","cited_by_count":8,"area":null},{"id":"2507.20057","title":"What Can Grokking Teach Us About Learning Under Nonstationarity?","created":"2025-07-26","cited_by_count":8,"area":null},{"id":"2402.01342","title":"Improving Model Fusion by Training-time Neuron Alignment with Fixed Neuron Anchors","created":"2024-02-02","cited_by_count":7,"area":null},{"id":"2405.17088","title":"Phase Transitions in the Output Distribution of Large Language Models","created":"2024-05-27","cited_by_count":7,"area":null},{"id":"2405.17420","title":"Survival of the Fittest Representation: A Case Study with Modular Addition","created":"2024-05-27","cited_by_count":7,"area":null},{"id":"2603.13331","title":"The Norm-Separation Delay Law of Grokking: A First-Principles Theory of Delayed Generalization","created":"2026-03-05","cited_by_count":7,"area":null},{"id":"2310.19470","title":"Bridging Lottery Ticket and Grokking: Understanding Grokking from Inner Structure of Networks","created":"2023-10-30","cited_by_count":6,"area":null},{"id":"2505.15624","title":"Mechanistic Insights into Grokking from the Embedding Layer","created":"2025-05-21","cited_by_count":6,"area":null},{"id":"2603.25009","title":"A Systematic Empirical Study of Grokking: Depth, Architecture, Activation, and Regularization","created":"2026-03-26","cited_by_count":6,"area":null},{"id":"2311.09058","title":"Improving Deep Learning Optimization through Constrained Parameter Regularization","created":"2023-11-15","cited_by_count":5,"area":null},{"id":"2408.12664","title":"Multilevel Interpretability Of Artificial Neural Networks: Leveraging Framework And Methods From Neuroscience","created":"2024-08-22","cited_by_count":5,"area":null},{"id":"2606.17120","title":"Noise-Driven Escape from Metastable Phases explains Grokking in Deep Neural Networks","created":"2026-06-15","cited_by_count":5,"area":null},{"id":"2307.09550","title":"The semantic landscape paradigm for neural networks","created":"2023-07-18","cited_by_count":4,"area":null},{"id":"2402.05916","title":"GenEFT: Understanding Statics and Dynamics of Model Generalization via Effective Theory","created":"2024-02-08","cited_by_count":4,"area":null},{"id":"2411.17182","title":"An In-depth Investigation of Sparse Rate Reduction in Transformer-like Models","created":"2024-11-26","cited_by_count":4,"area":null},{"id":"2502.01628","title":"Harmonic Loss Trains Interpretable AI Models","created":"2025-02-03","cited_by_count":4,"area":null},{"id":"2509.06931","title":"Learning words in groups: fusion algebras, tensor ranks and grokking","created":"2025-09-08","cited_by_count":4,"area":null},{"id":"2509.20829","title":"Explaining Grokking and Information Bottleneck through Neural Collapse Emergence","created":"2025-09-25","cited_by_count":4,"area":null},{"id":"2603.01192","title":"A Basin-Selection Perspective on Grokking via Singular Learning Theory","created":"2026-03-01","cited_by_count":4,"area":null},{"id":"2605.06152","title":"Grokking or Glitching? How Low-Precision Drives Slingshot Loss Spikes","created":"2026-05-07","cited_by_count":4,"area":null},{"id":"2605.09724","title":"Model Capacity Determines Grokking through Competing Memorisation and Generalisation Speeds","created":"2026-05-10","cited_by_count":4,"area":null},{"id":"2310.11282","title":"ChapGTP, ILLC's Attempt at Raising a BabyLM: Improving Data Efficiency by Automatic Task Formation","created":"2023-10-17","cited_by_count":3,"area":null},{"id":"2310.12977","title":"Training Dynamics of Deep Network Linear Regions","created":"2023-10-19","cited_by_count":3,"area":null},{"id":"2405.16658","title":"Acceleration of Grokking in Learning Arithmetic Operations via Kolmogorov-Arnold Representation","created":"2024-05-26","cited_by_count":3,"area":null},{"id":"2405.17479","title":"A rationale from frequency perspective for grokking in training neural network","created":"2024-05-24","cited_by_count":3,"area":null},{"id":"2505.20076","title":"ExPLAIND: Unifying Model, Data, and Training Attribution to Study Model Behavior","created":"2025-05-26","cited_by_count":3,"area":null},{"id":"2603.24746","title":"Grokking as a Falsifiable Finite-Size Transition","created":"2026-03-25","cited_by_count":3,"area":null},{"id":"2607.04333","title":"Structure-Specific Representational Priors Causally Control the Grokking Delay","created":"2026-07-05","cited_by_count":3,"area":null},{"id":"2310.12660","title":"Gradient Descent Fails to Learn High-frequency Functions and Modular Arithmetic","created":"2023-10-19","cited_by_count":2,"area":null},{"id":"2506.12284","title":"GrokAlign: Geometric Characterisation and Acceleration of Grokking","created":"2025-06-14","cited_by_count":2,"area":null},{"id":"2510.04930","title":"Egalitarian Gradient Descent: A Simple Approach to Accelerated Grokking","created":"2025-10-06","cited_by_count":2,"area":null},{"id":"2604.00230","title":"Neural Collapse Dynamics: Depth, Activation, Regularisation, and Feature Norm Threshold","created":"2026-03-31","cited_by_count":2,"area":null},{"id":"2604.13123","title":"Spectral Entropy Collapse as a Phase Transition in Delayed Generalisation: An Interventional and Predictive Framework for Grokkin","created":"2026-04-13","cited_by_count":2,"area":null},{"id":"2605.06352","title":"Topological Signatures of Grokking","created":"2026-05-07","cited_by_count":2,"area":null},{"id":"2605.20441","title":"Weight Decay Regimes in Grokking Transformers: Cheap Online Diagnostics","created":"2026-05-19","cited_by_count":2,"area":null},{"id":"2605.27078","title":"Two Speeds of Learning: A Representation-Readout Decomposition of Grokking and Double Descent","created":"2026-05-26","cited_by_count":2,"area":null},{"id":"2606.12966","title":"Learned Structure Shows Up Earlier in the Task's Own Basis: A Controlled Look at a Synchronisation Precursor in Grokking","created":"2026-06-11","cited_by_count":2,"area":null},{"id":"2607.23967","title":"Grokking on the Weight-Decay Clock: A Rate Hierarchy from Softly Broken Symmetries","created":"2026-07-27","cited_by_count":2,"area":null},{"id":"2402.08946","title":"Measuring Sharpness in Grokking","created":"2024-02-14","cited_by_count":1,"area":null},{"id":"2403.08739","title":"The Garden of Forking Paths: Observing Dynamic Parameters Distribution in Large Language Models","created":"2024-03-13","cited_by_count":1,"area":null},{"id":"2412.18624","title":"How to explain grokking","created":"2024-12-17","cited_by_count":1,"area":null},{"id":"2504.12700","title":"A Two-Phase Perspective on Deep Learning Dynamics","created":"2025-04-17","cited_by_count":1,"area":null},{"id":"2505.22578","title":"Favorability of Loss Landscape with Weight Decay Requires Both Large Overparametrization and Initialization","created":"2025-05-28","cited_by_count":1,"area":null},{"id":"2511.04760","title":"When Data Falls Short: Grokking Below the Critical Threshold","created":"2025-11-06","cited_by_count":1,"area":null},{"id":"2512.01231","title":"Implicitly Normalized Online PCA: A Regularized Algorithm with Exact High-Dimensional Dynamics","created":"2025-12-01","cited_by_count":1,"area":null},{"id":"2601.03162","title":"On the Convergence Behavior of Preconditioned Gradient Descent Toward the Rich Learning Regime","created":"2026-01-06","cited_by_count":1,"area":null},{"id":"2602.18649","title":"Global Low-Rank, Local Full-Rank: The Holographic Encoding of Learned Algorithms","created":"2026-02-20","cited_by_count":1,"area":null},{"id":"2602.22600","title":"Transformers converge to invariant algorithmic cores","created":"2026-02-26","cited_by_count":1,"area":null},{"id":"2603.15492","title":"Grokking as a Variance-Limited Phase Transition: Spectral Gating and the Epsilon-Stability Threshold","created":"2026-03-16","cited_by_count":1,"area":null},{"id":"2604.00316","title":"Breaking Data Symmetry is Needed For Generalization in Feature Learning Kernels","created":"2026-03-31","cited_by_count":1,"area":null},{"id":"2604.25143","title":"Gradient-Direction Sensitivity Reveals Linear-Centroid Coupling Hidden by Optimizer Trajectories","created":"2026-04-28","cited_by_count":1,"area":null},{"id":"2605.04396","title":"Critical Windows of Complexity Control: When Transformers Decide to Reason or Memorize","created":"2026-05-06","cited_by_count":1,"area":null},{"id":"2605.18845","title":"First-Passage Prediction of Grokking Delay: ACalibrated Law under AdamW with Causal Validation","created":"2026-05-13","cited_by_count":1,"area":null},{"id":"2606.04405","title":"Low-Rank Decay for Grokking in Scale-Invariant Transformers: A Spectral-Geometric View","created":"2026-06-03","cited_by_count":1,"area":null},{"id":"2606.05863","title":"Deciphering Two Training Clocks in Grokking via Deep Linear Network Theory with Conditional ReLU Reduction","created":"2026-06-04","cited_by_count":1,"area":null}],"next_cursor":"100"}