{"total":41,"rows":[{"id":"2604.21691","title":"There Will Be a Scientific Theory of Deep Learning","created":"2026-04-23","cited_by_count":29,"area":null},{"id":"2505.17863","title":"The emergence of sparse attention: impact of data distribution and benefits of repetition","created":"2025-05-23","cited_by_count":25,"area":null},{"id":"2503.05631","title":"Strategy Coopetition Explains the Emergence and Transience of In-Context Learning","created":"2025-03-07","cited_by_count":17,"area":null},{"id":"2512.20607","title":"Saddle-to-Saddle Dynamics Explains A Simplicity Bias Across Neural Network Architectures","created":"2025-12-23","cited_by_count":15,"area":null},{"id":"2506.06489","title":"Alternating Gradient Flows: A Theory of Feature Learning in Two-layer Neural Networks","created":"2025-06-06","cited_by_count":14,"area":null},{"id":"2603.01097","title":"Understanding LoRA as Knowledge Memory: An Empirical Analysis","created":"2026-03-01","cited_by_count":12,"area":null},{"id":"2510.06954","title":"From Condensation to Rank Collapse: A Two-Stage Analysis of Transformer Training Dynamics","created":"2025-10-08","cited_by_count":10,"area":null},{"id":"2602.03655","title":"Sequential Group Composition: A Window into the Mechanics of Deep Learning","created":"2026-02-03","cited_by_count":10,"area":null},{"id":"2603.00742","title":"To Use or not to Use Muon: How Simplicity Bias in Optimizers Matters","created":"2026-02-28","cited_by_count":10,"area":null},{"id":"2506.13688","title":"What Happens During the Loss Plateau? Understanding Abrupt Learning in Transformers","created":"2025-06-16","cited_by_count":7,"area":null},{"id":"2509.21936","title":"Statistical Advantage of Softmax Attention: Insights from Single-Location Regression","created":"2025-09-26","cited_by_count":7,"area":null},{"id":"2506.05249","title":"On the Convergence of Gradient Descent on Learning Transformers with Residual Connections","created":"2025-06-05","cited_by_count":6,"area":null},{"id":"2509.24914","title":"Single-Head Attention in High Dimensions: A Theory of Generalization, Weights Spectra, and Scaling Laws","created":"2025-09-29","cited_by_count":6,"area":null},{"id":"2506.01153","title":"Weight-Space Linear Recurrent Neural Networks","created":"2025-06-01","cited_by_count":5,"area":null},{"id":"2506.19351","title":"In-Context Occam's Razor: How Transformers Prefer Simpler Hypotheses on the Fly","created":"2025-06-24","cited_by_count":5,"area":null},{"id":"2511.01033","title":"On the Emergence of Induction Heads for In-Context Learning","created":"2025-11-02","cited_by_count":5,"area":null},{"id":"2510.10425","title":"Softmax $\\geq$ Linear: Transformers may learn to classify in-context by kernel gradient descent","created":"2025-10-12","cited_by_count":4,"area":null},{"id":"2504.12916","title":"Exact Learning Dynamics of In-Context Learning in Linear Transformers and Its Application to Non-Linear Transformers","created":"2025-04-17","cited_by_count":3,"area":null},{"id":"2512.11784","title":"Softmax as Linear Attention in the Large-Prompt Regime: a Measure-based Perspective","created":"2025-12-12","cited_by_count":3,"area":null},{"id":"2605.05176","title":"Understanding In-Context Learning for Nonlinear Regression with Transformers: Attention as Featurizer","created":"2026-05-06","cited_by_count":3,"area":null},{"id":"2602.04872","title":"Multi-layer Cross-attention is Provably Optimal for Multi-modal In-context Learning","created":"2026-02-04","cited_by_count":2,"area":null},{"id":"2602.19143","title":"Incremental Learning of Sparse Attention Patterns in Transformers","created":"2026-02-22","cited_by_count":2,"area":null},{"id":"2603.03993","title":"Specialization of softmax attention heads: insights from the high-dimensional single-location model","created":"2026-03-04","cited_by_count":2,"area":null},{"id":"2604.10946","title":"Learning to Adapt: In-Context Learning Beyond Stationarity","created":"2026-04-13","cited_by_count":2,"area":null},{"id":"2508.00385","title":"Multi-Layer Attention is the Amplifier of Demonstration Effectiveness","created":"2025-08-01","cited_by_count":1,"area":null},{"id":"2510.04548","title":"Learning Linear Regression with Low-Rank Tasks in-Context","created":"2025-10-06","cited_by_count":1,"area":null},{"id":"2511.19328","title":"Understanding the Staged Dynamics of Transformers in Learning Latent Structure","created":"2025-11-24","cited_by_count":1,"area":null},{"id":"2602.23197","title":"Fine-Tuning Without Forgetting In-Context Learning: A Theoretical Analysis of Linear Attention Models","created":"2026-02-26","cited_by_count":1,"area":null},{"id":"2605.08475","title":"Transformers Can Implement Preconditioned Richardson Iteration for In-Context Gaussian Kernel Regression","created":"2026-05-08","cited_by_count":1,"area":null},{"id":"2606.06814","title":"The Effect of Training Task Diversity on In-Context Learning through the Lens of Low-Dimensional Subspaces","created":"2026-06-05","cited_by_count":1,"area":null},{"id":"2606.17816","title":"Conservation Laws for Modern Neural Architectures","created":"2026-06-16","cited_by_count":1,"area":null},{"id":"2607.03660","title":"Sequential Correlations Change In-Context Learning: Effective Context Length and Architectural Mismatch","created":"2026-07-04","cited_by_count":1,"area":null},{"id":"2610.01712","title":"In-context Learning of Single-index Targets: Comparing Kernel and Feature Learners","created":"2026-10-01","cited_by_count":1,"area":null},{"id":"2507.01414","title":"Decomposing Prediction Mechanisms for In-Context Recall","created":"2025-07-02","cited_by_count":0,"area":null},{"id":"2507.02103","title":"What Neuroscience Can Teach AI About Learning in Continuously Changing Environments","created":"2025-07-02","cited_by_count":0,"area":null},{"id":"2602.00576","title":"Data Distribution as a Lever for Guiding Optimizers Toward Superior Generalization in LLMs","created":"2026-01-31","cited_by_count":0,"area":null},{"id":"2605.01288","title":"A Theory of Saddle Escape in Deep Nonlinear Networks","created":"2026-05-02","cited_by_count":0,"area":null},{"id":"2605.26489","title":"The Stability of Singular Distribution: A Spectral Perspective on the Two-Phase Dynamics of Language Model Pre-training","created":"2026-05-26","cited_by_count":0,"area":null},{"id":"2606.16694","title":"When Does Depth Matter For In-Context Learning? Adaptive Inference in Deep Transformers","created":"2026-06-15","cited_by_count":0,"area":null},{"id":"2608.26139","title":"Syntax vs. Semantics: How Transformers Learn Deep Dependencies","created":"2026-06-26","cited_by_count":0,"area":null},{"id":"2610.03463","title":"Generalization of Transformer-Based Neural Quantum States via In-Context Learning","created":"2026-10-02","cited_by_count":0,"area":null}],"next_cursor":null}