{"total":27,"rows":[{"id":"2410.02984","title":"Differentiation and Specialization of Attention Heads via the Refined Local Learning Coefficient","created":"2024-10-03","cited_by_count":40,"area":null},{"id":"2502.19249","title":"Between Circuits and Chomsky: Pre-pretraining on Formal Languages Imparts Linguistic Biases","created":"2025-02-26","cited_by_count":37,"area":null},{"id":"2503.09543","title":"PolyPythias: Stability and Outliers across Fifty Language Model Pre-Training Runs","created":"2025-03-12","cited_by_count":35,"area":null},{"id":"2509.23024","title":"Tracing the Representation Geometry of Language Models from Pretraining to Post-training","created":"2025-09-27","cited_by_count":35,"area":null},{"id":"2410.19637","title":"A distributional simplicity bias in the learning dynamics of transformers","created":"2024-10-25","cited_by_count":24,"area":null},{"id":"2510.24963","title":"Language Model Behavioral Phases are Consistent Across Architecture, Training Data, and Scale","created":"2025-10-28","cited_by_count":13,"area":null},{"id":"2404.08602","title":"Sliding down the stairs: how correlated latent variables accelerate learning with neural networks","created":"2024-04-12","cited_by_count":12,"area":null},{"id":"2509.17196","title":"Evolution of Concepts in Language Model Pre-Training","created":"2025-09-21","cited_by_count":8,"area":null},{"id":"2410.11451","title":"Tending Towards Stability: Convergence Challenges in Small Language Models","created":"2024-10-15","cited_by_count":7,"area":null},{"id":"2506.13688","title":"What Happens During the Loss Plateau? Understanding Abrupt Learning in Transformers","created":"2025-06-16","cited_by_count":7,"area":null},{"id":"2410.06024","title":"Jet Expansions of Residual Computation","created":"2024-10-08","cited_by_count":4,"area":null},{"id":"2406.17467","title":"Early learning of the optimal constant solution in neural networks and humans","created":"2024-06-25","cited_by_count":3,"area":null},{"id":"2509.26643","title":"Convergence and Divergence of Language Models under Different Random Seeds","created":"2025-09-30","cited_by_count":3,"area":null},{"id":"2606.06533","title":"Position: Don't Just \"Fix it in Post\": A Science of AI Must Study Training Dynamics","created":"2026-06-03","cited_by_count":3,"area":null},{"id":"2510.25480","title":"Gradient-Weight Alignment as a Train-Time Proxy for Generalization in Classification Tasks","created":"2025-10-29","cited_by_count":1,"area":null},{"id":"2608.23573","title":"Data Predictability Shapes Weibull Weight-Scale Growth in Transformer Training","created":"2026-06-27","cited_by_count":1,"area":null},{"id":"2502.03490","title":"Examining Two Hop Reasoning Through Information Content Scaling","created":"2025-02-05","cited_by_count":0,"area":null},{"id":"2510.04285","title":"Probing Geometry of Next Token Prediction Using Cumulant Expansion of the Softmax Entropy","created":"2025-10-05","cited_by_count":0,"area":null},{"id":"2602.02153","title":"Learning Beyond the Gaussian Data: Learning Dynamics of Neural Networks on an Expressive and Cumulant-Controllable Data Model","created":"2026-02-02","cited_by_count":0,"area":null},{"id":"2604.00394","title":"Deep Networks Favor Simple Data","created":"2026-04-01","cited_by_count":0,"area":null},{"id":"2605.07844","title":"Distributional simplicity bias and effective convexity in Energy Based Models","created":"2026-05-08","cited_by_count":0,"area":null},{"id":"2605.16913","title":"A Fourier perspective on the learning dynamics of neural networks: from sample complexities to mechanistic insights","created":"2026-05-16","cited_by_count":0,"area":null},{"id":"2605.29669","title":"Eigen-Spike Emergence and Quadratic Equivalents for Conjugate Kernels on Nonlinearly Separable Data","created":"2026-05-28","cited_by_count":0,"area":null},{"id":"2607.04061","title":"Telescope: Improving Zero Shot Detection of LLM Generated Content By Measuring Token Repetition Probability","created":"2026-07-05","cited_by_count":0,"area":null},{"id":"2607.04846","title":"Pretraining Curricula Enable Selective Fine-tuning","created":"2026-07-06","cited_by_count":0,"area":null},{"id":"2607.09487","title":"Neural Collapse Is Forbidden: Information Floors in Language Models","created":"2026-07-10","cited_by_count":0,"area":null},{"id":"2609.38764","title":"Lasting Effects of Abstract Pretraining Beyond Perplexity","created":"2026-09-30","cited_by_count":0,"area":null}],"next_cursor":null}