{"total":53,"rows":[{"id":"2309.07311","title":"Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs","created":"2023-09-13","cited_by_count":124,"area":null},{"id":"2410.23123","title":"On Memorization of Large Language Models in Logical Reasoning","created":"2024-10-30","cited_by_count":117,"area":"lr"},{"id":"2405.15071","title":"Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization","created":"2024-05-23","cited_by_count":79,"area":"lr"},{"id":"2310.14491","title":"Towards a Mechanistic Interpretation of Multi-Step Reasoning Capabilities of Language Models","created":"2023-10-23","cited_by_count":50,"area":"lr"},{"id":"2312.03656","title":"Interpretability Illusions in the Generalization of Simplified Models","created":"2023-12-06","cited_by_count":25,"area":null},{"id":"2410.09087","title":"Mechanistic?","created":"2024-10-07","cited_by_count":25,"area":"mechinterp"},{"id":"2404.16367","title":"Learning Syntax Without Planting Trees: Understanding Hierarchical Generalization in Transformers","created":"2024-04-25","cited_by_count":24,"area":null},{"id":"2408.15417","title":"Implicit Geometry of Next-token Prediction: From Language Sparsity Patterns to Model Representations","created":"2024-08-27","cited_by_count":24,"area":null},{"id":"2401.03910","title":"A Philosophical Introduction to Language Models -- Part I: Continuity With Classic Debates","created":"2024-01-08","cited_by_count":23,"area":null},{"id":"2405.05847","title":"Learned feature representations are biased by complexity, learning order, position, and more","created":"2024-05-09","cited_by_count":23,"area":null},{"id":"2402.02098","title":"Self-attention Networks Localize When QK-eigenspectrum Concentrates","created":"2024-02-03","cited_by_count":19,"area":null},{"id":"2310.01749","title":"Stack Attention: Improving the Ability of Transformers to Model Hierarchical Patterns","created":"2023-10-03","cited_by_count":17,"area":null},{"id":"2506.15872","title":"Hidden Breakthroughs in Language Model Training","created":"2025-06-18","cited_by_count":15,"area":null},{"id":"2509.16189","title":"Latent learning: episodic memory complements parametric learning by enabling flexible reuse of experiences","created":"2025-09-19","cited_by_count":15,"area":null},{"id":"2402.16726","title":"Towards Empirical Interpretation of Internal Circuits and Properties in Grokked Transformers on Modular Polynomials","created":"2024-02-26","cited_by_count":14,"area":null},{"id":"2310.17247","title":"Grokking Beyond Neural Networks: An Empirical Exploration with Model Complexity","created":"2023-10-26","cited_by_count":13,"area":null},{"id":"2405.08707","title":"Beyond Scaling Laws: Understanding Transformer Performance with Associative Memory","created":"2024-05-14","cited_by_count":12,"area":null},{"id":"2410.18225","title":"Generalizations across filler-gap dependencies in neural language models","created":"2024-10-23","cited_by_count":12,"area":null},{"id":"2410.18808","title":"Delving into the Reversal Curse: How Far Can Large Language Models Generalize?","created":"2024-10-24","cited_by_count":11,"area":null},{"id":"2403.03942","title":"The Heuristic Core: Understanding Subnetwork Generalization in Pretrained Language Models","created":"2024-03-06","cited_by_count":10,"area":null},{"id":"2412.04619","title":"Sometimes I am a Tree: Data Drives Unstable Hierarchical Generalization","created":"2024-12-05","cited_by_count":10,"area":null},{"id":"2605.29548","title":"Why Larger Models Learn More: Effects of Capacity, Interference, and Rare-Task Retention","created":"2026-05-28","cited_by_count":10,"area":null},{"id":"2410.02247","title":"Theoretical Insights into Fine-Tuning Attention Mechanism: Generalization and Optimization","created":"2024-10-03","cited_by_count":9,"area":null},{"id":"2507.06445","title":"Can Interpretation Predict Behavior on Unseen Data?","created":"2025-07-08","cited_by_count":8,"area":null},{"id":"2509.17738","title":"Flatness is Necessary, Neural Collapse is Not: Rethinking Generalization via Grokking","created":"2025-09-22","cited_by_count":8,"area":null},{"id":"2502.17356","title":"Random Scaling of Emergent Capabilities","created":"2025-02-24","cited_by_count":7,"area":null},{"id":"2602.16967","title":"Early-Warning Signals of Grokking via Loss-Landscape Geometry","created":"2026-02-19","cited_by_count":7,"area":null},{"id":"2310.19470","title":"Bridging Lottery Ticket and Grokking: Understanding Grokking from Inner Structure of Networks","created":"2023-10-30","cited_by_count":6,"area":null},{"id":"2407.08330","title":"HDT: Hierarchical Document Transformer","created":"2024-07-11","cited_by_count":6,"area":null},{"id":"2501.00759","title":"Enhancing Transformers for Generalizable First-Order Logical Entailment","created":"2025-01-01","cited_by_count":6,"area":null},{"id":"2311.00128","title":"On the effect of curriculum learning with developmental data for grammar acquisition","created":"2023-10-31","cited_by_count":5,"area":null},{"id":"2405.04048","title":"Philosophy of Cognitive Science in the Age of Deep Learning","created":"2024-05-07","cited_by_count":5,"area":null},{"id":"2307.09550","title":"The semantic landscape paradigm for neural networks","created":"2023-07-18","cited_by_count":4,"area":null},{"id":"2404.01204","title":"The Fine Line: Navigating Large Language Model Pretraining with Down-streaming Capability Analysis","created":"2024-04-01","cited_by_count":4,"area":null},{"id":"2310.11282","title":"ChapGTP, ILLC's Attempt at Raising a BabyLM: Improving Data Efficiency by Automatic Task Formation","created":"2023-10-17","cited_by_count":3,"area":null},{"id":"2411.18885","title":"Sneaking Syntax into Transformer Language Models with Tree Regularization","created":"2024-11-28","cited_by_count":3,"area":null},{"id":"2506.23286","title":"Not All Explanations for Deep Learning Phenomena Are Equally Valuable","created":"2025-06-29","cited_by_count":3,"area":null},{"id":"2409.13728","title":"Rule Extrapolation in Language Models: A Study of Compositional Generalization on OOD Prompts","created":"2024-09-09","cited_by_count":2,"area":null},{"id":"2510.04930","title":"Egalitarian Gradient Descent: A Simple Approach to Accelerated Grokking","created":"2025-10-06","cited_by_count":2,"area":null},{"id":"2604.22128","title":"Dissociating Decodability and Causal Use in Bracket-Sequence Transformers","created":"2026-04-24","cited_by_count":2,"area":null},{"id":"2508.12482","title":"The Structural Sources of Verb Meaning Revisited: Large Language Models Display Syntactic Bootstrapping","created":"2025-08-17","cited_by_count":1,"area":"synth"},{"id":"2511.03547","title":"Bearing Syntactic Fruit with Stack-Augmented Neural Networks","created":"2025-11-05","cited_by_count":1,"area":null},{"id":"2601.09049","title":"Is Grokking Worthwhile? Functional Analysis and Transferability of Generalization Circuits in Transformers","created":"2026-01-14","cited_by_count":1,"area":"mechinterp"},{"id":"2601.19926","title":"The Grammar of Transformers: A Systematic Review of Interpretability Research on Syntactic Knowledge in Language Models","created":"2026-01-09","cited_by_count":1,"area":null},{"id":"2602.09992","title":"A Unified Assessment of the Poverty of the Stimulus Argument for Neural Language Models","created":"2026-02-10","cited_by_count":1,"area":null},{"id":"2605.15787","title":"Grokking as Structural Inference: Transformers Need Bayesian Lottery Tickets","created":"2026-05-15","cited_by_count":1,"area":null},{"id":"2606.00230","title":"A Pre-Training Analogue of Grokking in Language Models: Tracing Delayed Grammatical Generalization","created":"2026-05-29","cited_by_count":1,"area":null},{"id":"2606.26050","title":"Natural Ungrokking: Asymmetric Control of Which Rules Survive Pretraining","created":"2026-06-24","cited_by_count":1,"area":null},{"id":"2606.27460","title":"Developmental approach reveals the statistical learning of Neural Language Models: Transformers generalize from the most abstract statistical patterns","created":"2026-06-25","cited_by_count":1,"area":null},{"id":"2504.15349","title":"Exploring Compositional Generalization (in COGS/ReCOGS_pos) by Transformers using Restricted Access Sequence Processing (RASP)","created":"2025-04-21","cited_by_count":0,"area":null},{"id":"2511.08199","title":"Do Syntactic Categories Help in Developmentally Motivated Curriculum Learning for Language Models?","created":"2025-11-11","cited_by_count":0,"area":null},{"id":"2601.03424","title":"Spectral Archaeology: The Causal Topology of Model Evolution","created":"2026-01-06","cited_by_count":0,"area":null},{"id":"2609.34936","title":"Neural Language Models Learn the Contextual Distributions of Dependency Structures: a statistical learning theory to compositionality","created":"2026-09-28","cited_by_count":0,"area":null}],"next_cursor":null}