{"total":598,"rows":[{"id":"2307.05782","title":"Large Language Models","created":"2023-07-11","cited_by_count":780,"area":null},{"id":"2404.19756","title":"KAN: Kolmogorov-Arnold Networks","created":"2024-04-30","cited_by_count":649,"area":null},{"id":"2304.14767","title":"Dissecting Recall of Factual Associations in Auto-Regressive Language Models","created":"2023-04-28","cited_by_count":528,"area":null},{"id":"2305.01610","title":"Finding Neurons in a Haystack: Case Studies with Sparse Probing","created":"2023-05-02","cited_by_count":334,"area":null},{"id":"2402.10588","title":"Do Llamas Work in English? On the Latent Language of Multilingual Transformers","created":"2024-02-16","cited_by_count":281,"area":null},{"id":"2405.14860","title":"Not All Language Model Features Are One-Dimensionally Linear","created":"2024-05-23","cited_by_count":212,"area":null},{"id":"2305.00586","title":"How does GPT-2 compute greater-than?: Interpreting mathematical abilities in a pre-trained language model","created":"2023-04-30","cited_by_count":202,"area":null},{"id":"2310.16028","title":"What Algorithms can Transformers Learn? A Study in Length Generalization","created":"2023-10-24","cited_by_count":199,"area":null},{"id":"2310.05916","title":"Interpreting CLIP's Image Representation via Text-Based Decomposition","created":"2023-10-09","cited_by_count":196,"area":null},{"id":"2305.15324","title":"Model evaluation for extreme risks","created":"2023-05-24","cited_by_count":177,"area":null},{"id":"2306.00802","title":"Birth of a Transformer: A Memory Viewpoint","created":"2023-06-01","cited_by_count":161,"area":null},{"id":"2306.17844","title":"The Clock and the Pizza: Two Stories in Mechanistic Explanation of Neural Networks","created":"2023-06-30","cited_by_count":156,"area":null},{"id":"2307.15771","title":"The Hydra Effect: Emergent Self-repair in Language Model Computations","created":"2023-07-28","cited_by_count":156,"area":null},{"id":"2307.09458","title":"Does Circuit Analysis Interpretability Scale? Evidence from Multiple Choice Capabilities in Chinchilla","created":"2023-07-18","cited_by_count":149,"area":null},{"id":"2402.14811","title":"Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity Tracking","created":"2024-02-22","cited_by_count":149,"area":null},{"id":"2310.13018","title":"Getting aligned on representational alignment","created":"2023-10-18","cited_by_count":143,"area":null},{"id":"2303.13506","title":"The Quantization Model of Neural Scaling","created":"2023-03-23","cited_by_count":138,"area":null},{"id":"2401.14446","title":"Black-Box Access is Insufficient for Rigorous AI Audits","created":"2024-01-25","cited_by_count":126,"area":null},{"id":"2310.19775","title":"Explainable Artificial Intelligence (XAI) 2.0: A Manifesto of Open Challenges and Interdisciplinary Research Directions","created":"2023-10-30","cited_by_count":125,"area":null},{"id":"2309.07311","title":"Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs","created":"2023-09-13","cited_by_count":124,"area":null},{"id":"2307.14430","title":"Skill-it! A Data-Driven Skills Framework for Understanding and Training Language Models","created":"2023-07-26","cited_by_count":121,"area":null},{"id":"2412.05563","title":"A Survey on Uncertainty Quantification of Large Language Models: Taxonomy, Open Research Challenges, and Future Directions","created":"2024-12-07","cited_by_count":121,"area":null},{"id":"2408.10205","title":"KAN 2.0: Kolmogorov-Arnold Networks Meet Science","created":"2024-08-19","cited_by_count":118,"area":null},{"id":"2309.02390","title":"Explaining grokking through circuit efficiency","created":"2023-09-05","cited_by_count":111,"area":null},{"id":"2310.06110","title":"Grokking as the Transition from Lazy to Rich Training Dynamics","created":"2023-10-09","cited_by_count":108,"area":null},{"id":"2310.17191","title":"How do Language Models Bind Entities in Context?","created":"2023-10-26","cited_by_count":108,"area":null},{"id":"2504.02234","title":"LLM Social Simulations Are a Promising Research Method","created":"2025-04-03","cited_by_count":99,"area":null},{"id":"2506.11613","title":"Model Organisms for Emergent Misalignment","created":"2025-06-13","cited_by_count":91,"area":null},{"id":"2405.00208","title":"A Primer on the Inner Workings of Transformer-based Language Models","created":"2024-04-30","cited_by_count":85,"area":null},{"id":"2407.13692","title":"Prover-Verifier Games improve legibility of LLM outputs","created":"2024-07-18","cited_by_count":85,"area":null},{"id":"2303.11873","title":"A Tale of Two Circuits: Grokking as Competition of Sparse and Dense Subnetworks","created":"2023-03-21","cited_by_count":83,"area":null},{"id":"2305.13673","title":"Physics of Language Models: Part 1, Learning Hierarchical Language Structures","created":"2023-05-23","cited_by_count":83,"area":null},{"id":"2311.18817","title":"Dichotomy of Early and Late Phase Implicit Biases Can Provably Induce Grokking","created":"2023-11-30","cited_by_count":80,"area":null},{"id":"2406.12775","title":"Hopping Too Late: Exploring the Limitations of Large Language Models on Multi-Hop Queries","created":"2024-06-18","cited_by_count":78,"area":null},{"id":"2312.09230","title":"Successor Heads: Recurring, Interpretable Attention Heads In The Wild","created":"2023-12-14","cited_by_count":77,"area":null},{"id":"2311.08360","title":"The Transient Nature of Emergent In-Context Learning in Transformers","created":"2023-11-14","cited_by_count":76,"area":null},{"id":"2407.10827","title":"LLM Circuit Analyses Are Consistent Across Training and Scale","created":"2024-07-15","cited_by_count":63,"area":null},{"id":"2310.19793","title":"On Learning Gaussian Multi-index Models with Gradient Flow","created":"2023-10-30","cited_by_count":57,"area":null},{"id":"2406.16254","title":"Confidence Regulation Neurons in Language Models","created":"2024-06-24","cited_by_count":57,"area":null},{"id":"2410.13835","title":"Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMs","created":"2024-10-17","cited_by_count":56,"area":null},{"id":"2402.15555","title":"Deep Networks Always Grok and Here is Why","created":"2024-02-23","cited_by_count":51,"area":null},{"id":"2402.11917","title":"A Mechanistic Analysis of a Transformer Trained on a Symbolic Multi-Step Reasoning Task","created":"2024-02-19","cited_by_count":49,"area":null},{"id":"2404.00859","title":"Do language models plan ahead for future tokens?","created":"2024-04-01","cited_by_count":49,"area":null},{"id":"2303.08117","title":"Do Transformers Parse while Predicting the Masked Word?","created":"2023-03-14","cited_by_count":48,"area":null},{"id":"2310.03789","title":"Grokking as a First Order Phase Transition in Two Layer Networks","created":"2023-10-05","cited_by_count":48,"area":null},{"id":"2310.15910","title":"Characterizing Mechanisms for Factual Recall in Language Models","created":"2023-10-24","cited_by_count":48,"area":null},{"id":"2501.04697","title":"Grokking at the Edge of Numerical Stability","created":"2025-01-08","cited_by_count":46,"area":null},{"id":"2501.16265","title":"Training Dynamics of In-Context Learning in Linear Attention","created":"2025-01-27","cited_by_count":46,"area":null},{"id":"2601.04480","title":"When Models Manipulate Manifolds: The Geometry of a Counting Task","created":"2026-01-08","cited_by_count":46,"area":null},{"id":"2403.01548","title":"In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation","created":"2024-03-03","cited_by_count":45,"area":null},{"id":"2504.04264","title":"Lost in Multilinguality: Dissecting Cross-lingual Factual Inconsistency in Transformer Language Models","created":"2025-04-05","cited_by_count":44,"area":null},{"id":"2510.04340","title":"Inoculation Prompting: Eliciting traits from LLMs during training can suppress them at test-time","created":"2025-10-05","cited_by_count":43,"area":null},{"id":"2406.06158","title":"Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning","created":"2024-06-10","cited_by_count":42,"area":null},{"id":"2405.20233","title":"Grokfast: Accelerated Grokking by Amplifying Slow Gradients","created":"2024-05-30","cited_by_count":41,"area":null},{"id":"2402.02364","title":"Loss Landscape Degeneracy and Stagewise Development in Transformers","created":"2024-02-04","cited_by_count":40,"area":null},{"id":"2402.04161","title":"Attention with Markov: A Framework for Principled Analysis of Transformers via Markov Chains","created":"2024-02-06","cited_by_count":40,"area":null},{"id":"2402.11655","title":"Competition of Mechanisms: Tracing How Language Models Handle Facts and Counterfactuals","created":"2024-02-18","cited_by_count":40,"area":null},{"id":"2410.02984","title":"Differentiation and Specialization of Attention Heads via the Refined Local Learning Coefficient","created":"2024-10-03","cited_by_count":40,"area":null},{"id":"2402.15390","title":"Explorations of Self-Repair in Language Models","created":"2024-02-23","cited_by_count":39,"area":null},{"id":"2403.18167","title":"Mechanistic Understanding and Mitigation of Language Model Non-Factual Hallucinations","created":"2024-03-27","cited_by_count":38,"area":null},{"id":"2310.18362","title":"SoK: Memorization in General-Purpose Large Language Models","created":"2023-10-24","cited_by_count":37,"area":null},{"id":"2312.12141","title":"Neuron-Level Knowledge Attribution in Large Language Models","created":"2023-12-19","cited_by_count":37,"area":null},{"id":"2503.21676","title":"How do language models learn facts? Dynamics, curricula and hallucinations","created":"2025-03-27","cited_by_count":37,"area":null},{"id":"2406.04341","title":"Interpreting the Second-Order Effects of Neurons in CLIP","created":"2024-06-06","cited_by_count":36,"area":null},{"id":"2407.12332","title":"Why Do You Grok? A Theoretical Analysis of Grokking Modular Addition","created":"2024-07-17","cited_by_count":36,"area":null},{"id":"2310.13121","title":"Understanding Addition in Transformers","created":"2023-10-19","cited_by_count":34,"area":null},{"id":"2308.15594","title":"Learning the greatest common divisor: explaining transformer predictions","created":"2023-08-29","cited_by_count":33,"area":null},{"id":"2309.08632","title":"Pretraining on the Test Set Is All You Need","created":"2023-09-13","cited_by_count":33,"area":null},{"id":"2310.02541","title":"Benign Overfitting and Grokking in ReLU Networks for XOR Cluster Data","created":"2023-10-04","cited_by_count":33,"area":null},{"id":"2311.07568","title":"Feature emergence via margin maximization: case studies in algebraic tasks","created":"2023-11-13","cited_by_count":33,"area":null},{"id":"2309.03886","title":"FIND: A Function Description Benchmark for Evaluating Interpretability Methods","created":"2023-09-07","cited_by_count":32,"area":null},{"id":"2311.13594","title":"Labeling Neural Representations with Inverse Recognition","created":"2023-11-22","cited_by_count":32,"area":null},{"id":"2410.11781","title":"Language Models Encode Numbers Using Digit Representations in Base 10","created":"2024-10-15","cited_by_count":32,"area":null},{"id":"2408.11804","title":"Approaching Deep Learning through the Spectral Dynamics of Weights","created":"2024-08-21","cited_by_count":31,"area":null},{"id":"2312.01429","title":"Transformers are uninterpretable with myopic methods: a case study with bounded Dyck grammars","created":"2023-12-03","cited_by_count":30,"area":null},{"id":"2405.21030","title":"Standards for Belief Representations in LLMs","created":"2024-05-31","cited_by_count":30,"area":null},{"id":"2511.08579","title":"Training Language Models to Explain Their Own Computations","created":"2025-11-11","cited_by_count":30,"area":null},{"id":"2604.21691","title":"There Will Be a Scientific Theory of Deep Learning","created":"2026-04-23","cited_by_count":29,"area":null},{"id":"2407.20199","title":"Emergence in non-neural models: grokking modular arithmetic via average gradient outer product","created":"2024-07-29","cited_by_count":28,"area":null},{"id":"2408.09503","title":"Out-of-distribution generalization via composition: a lens through induction heads in Transformers","created":"2024-08-18","cited_by_count":28,"area":null},{"id":"2502.04506","title":"When One LLM Drools, Multi-LLM Collaboration Rules","created":"2025-02-06","cited_by_count":28,"area":null},{"id":"2309.05973","title":"Circuit Breaking: Removing Model Behaviors with Targeted Ablation","created":"2023-09-12","cited_by_count":27,"area":null},{"id":"2403.00071","title":"Resonance RoPE: Improving Context Length Generalization of Large Language Models","created":"2024-02-29","cited_by_count":27,"area":null},{"id":"2310.16441","title":"Grokking in Linear Estimators -- A Solvable Model that Groks without Understanding","created":"2023-10-25","cited_by_count":25,"area":null},{"id":"2312.03656","title":"Interpretability Illusions in the Generalization of Simplified Models","created":"2023-12-06","cited_by_count":25,"area":null},{"id":"2405.20131","title":"Language Models Need Inductive Biases to Count Inductively","created":"2024-05-30","cited_by_count":25,"area":null},{"id":"2505.17863","title":"The emergence of sparse attention: impact of data distribution and benefits of repetition","created":"2025-05-23","cited_by_count":25,"area":null},{"id":"2310.09753","title":"When can transformers reason with abstract symbols?","created":"2023-10-15","cited_by_count":24,"area":null},{"id":"2310.13061","title":"To grok or not to grok: Disentangling generalization and memorization on corrupted algorithmic datasets","created":"2023-10-19","cited_by_count":24,"area":null},{"id":"2312.02073","title":"A Glitch in the Matrix? Locating and Detecting Language Model Grounding with Fakepedia","created":"2023-12-04","cited_by_count":24,"area":null},{"id":"2312.06581","title":"Grokking Group Multiplication with Cosets","created":"2023-12-11","cited_by_count":24,"area":null},{"id":"2401.10463","title":"Critical Data Size of Language Models from a Grokking Perspective","created":"2024-01-19","cited_by_count":24,"area":null},{"id":"2404.16367","title":"Learning Syntax Without Planting Trees: Understanding Hierarchical Generalization in Transformers","created":"2024-04-25","cited_by_count":24,"area":null},{"id":"2408.07144","title":"Language Models as Models of Language","created":"2024-08-13","cited_by_count":24,"area":null},{"id":"2312.08550","title":"Harmonics of Learning: Universal Fourier Features Emerge in Invariant Networks","created":"2023-12-13","cited_by_count":23,"area":null},{"id":"2402.15175","title":"Unified View of Grokking, Double Descent and Emergent Abilities: A Perspective from Circuits Competition","created":"2024-02-23","cited_by_count":23,"area":null},{"id":"2405.05847","title":"Learned feature representations are biased by complexity, learning order, position, and more","created":"2024-05-09","cited_by_count":23,"area":null},{"id":"2310.03686","title":"DecoderLens: Layerwise Interpretation of Encoder-Decoder Transformers","created":"2023-10-05","cited_by_count":22,"area":null},{"id":"2311.12997","title":"Compositional Capabilities of Autoregressive Transformers: A Study on Synthetic, Interpretable Tasks","created":"2023-11-21","cited_by_count":22,"area":null},{"id":"2406.06893","title":"Transformers Provably Learn Sparse Token Selection While Fully-Connected Nets Cannot","created":"2024-06-11","cited_by_count":22,"area":null}],"next_cursor":"100"}