{"list":"other","total":57,"rows":[{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"2203.15556","title":"Training Compute-Optimal Large Language Models","created":"2022-03-29","cited_by_count":3019},{"id":"2202.05262","title":"Locating and Editing Factual Associations in GPT","created":"2022-02-10","cited_by_count":2691},{"id":"2309.08600","title":"Sparse Autoencoders Find Highly Interpretable Features in Language Models","created":"2023-09-15","cited_by_count":1420},{"id":"1610.01644","title":"Understanding intermediate layers using linear classifier probes","created":"2016-10-05","cited_by_count":1353},{"id":"2209.10652","title":"Toy Models of Superposition","created":"2022-09-21","cited_by_count":971},{"id":"2301.05217","title":"Progress measures for grokking via mechanistic interpretability","created":"2023-01-12","cited_by_count":839},{"id":"1712.00409","title":"Deep Learning Scaling is Predictable, Empirically","created":"2017-12-01","cited_by_count":582},{"id":"2406.04093","title":"Scaling and evaluating sparse autoencoders","created":"2024-06-06","cited_by_count":553},{"id":"2010.14701","title":"Scaling Laws for Autoregressive Generative Modeling","created":"2020-10-28","cited_by_count":522},{"id":"2404.14082","title":"Mechanistic Interpretability for AI Safety -- A Review","created":"2024-04-22","cited_by_count":422},{"id":"2408.05147","title":"Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2","created":"2024-08-09","cited_by_count":394},{"id":"2102.06701","title":"Explaining Neural Scaling Laws","created":"2021-02-12","cited_by_count":363},{"id":"2305.01610","title":"Finding Neurons in a Haystack: Case Studies with Sparse Probing","created":"2023-05-02","cited_by_count":334},{"id":"2309.14316","title":"Physics of Language Models: Part 3.1, Knowledge Storage and Extraction","created":"2023-09-25","cited_by_count":270},{"id":"2210.10749","title":"Transformers Learn Shortcuts to Automata","created":"2022-10-19","cited_by_count":268},{"id":"1803.06992","title":"Estimating the intrinsic dimension of datasets by a minimal neighborhood information","created":"2018-03-19","cited_by_count":250},{"id":"2002.02561","title":"Spectrum Dependent Learning Curves in Kernel Regression and Wide Neural Networks","created":"2020-02-07","cited_by_count":200},{"id":"2605.29358","title":"Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet","created":"2026-05-28","cited_by_count":191},{"id":"2409.14507","title":"A is for Absorption: Studying Feature Splitting and Absorption in Sparse Autoencoders","created":"2024-09-22","cited_by_count":160},{"id":"2503.17547","title":"Learning Multi-Level Features with Matryoshka Sparse Autoencoders","created":"2025-03-21","cited_by_count":143},{"id":"2303.13506","title":"The Quantization Model of Neural Scaling","created":"2023-03-23","cited_by_count":138},{"id":"2210.16859","title":"A Solvable Model of Neural Scaling Laws","created":"2022-10-30","cited_by_count":116},{"id":"2101.08515","title":"Pre-training without Natural Images","created":"2021-01-21","cited_by_count":100},{"id":"2402.16991","title":"A Phase Transition in Diffusion Models Reveals the Hierarchical Nature of Data","created":"2024-02-26","cited_by_count":93},{"id":"2106.05963","title":"Learning to See by Looking at Noise","created":"2021-06-10","cited_by_count":92},{"id":"2502.04878","title":"Sparse Autoencoders Do Not Find Canonical Units of Analysis","created":"2025-02-07","cited_by_count":88},{"id":"2102.04074","title":"Learning Curve Theory","created":"2021-02-08","cited_by_count":85},{"id":"2305.13673","title":"Physics of Language Models: Part 1, Learning Hierarchical Language Structures","created":"2023-05-23","cited_by_count":83},{"id":"2307.02129","title":"How Deep Neural Networks Learn Compositional Data: The Random Hierarchy Model","created":"2023-07-05","cited_by_count":71},{"id":"2405.00592","title":"Scaling and renormalization in high-dimensional regression","created":"2024-05-01","cited_by_count":50},{"id":"2402.11917","title":"A Mechanistic Analysis of a Transformer Trained on a Symbolic Multi-Step Reasoning Task","created":"2024-02-19","cited_by_count":49},{"id":"2506.03093","title":"From Flat to Hierarchical: Extracting Sparse Representations with Matching Pursuit","created":"2025-06-03","cited_by_count":49},{"id":"2406.00048","title":"Towards a theory of how the structure of language is acquired by deep neural networks","created":"2024-05-28","cited_by_count":39},{"id":"2604.21691","title":"There Will Be a Scientific Theory of Deep Learning","created":"2026-04-23","cited_by_count":29},{"id":"2408.12578","title":"A Percolation Model of Emergence: Analyzing Transformers Trained on a Formal Language","created":"2024-08-22","cited_by_count":26},{"id":"1903.03488","title":"Is Deeper Better only when Shallow is Good?","created":"2019-03-08","cited_by_count":24},{"id":"2602.07488","title":"Deriving Neural Scaling Laws from the statistics of natural language","created":"2026-02-07","cited_by_count":23},{"id":"2404.17563","title":"An exactly solvable model for emergence and scaling laws in the multitask sparse parity problem","created":"2024-04-26","cited_by_count":22},{"id":"2408.15138","title":"How transformers learn structured data: insights from hierarchical filtering","created":"2024-08-27","cited_by_count":18},{"id":"2410.11767","title":"Analyzing (In)Abilities of SAEs via Formal Languages","created":"2024-10-15","cited_by_count":17},{"id":"2502.05475","title":"You Are What You Eat -- AI Alignment Requires Understanding How Data Shapes Structure and Generalisation","created":"2025-02-08","cited_by_count":17},{"id":"2505.07067","title":"Learning curves theory for hierarchically compositional data with power-law distributed features","created":"2025-05-11","cited_by_count":17},{"id":"2412.07942","title":"Neural Scaling Laws Rooted in the Data Distribution","created":"2024-12-10","cited_by_count":15},{"id":"2504.09597","title":"Understanding LLM Behaviors via Compression: Data Generation, Knowledge Acquisition and Scaling Laws","created":"2025-04-13","cited_by_count":15},{"id":"2408.00677","title":"Scaling Backwards: Minimal Synthetic Pre-training?","created":"2024-08-01","cited_by_count":14},{"id":"2408.13256","title":"How Diffusion Models Learn to Factorize and Compose","created":"2024-08-23","cited_by_count":13},{"id":"2507.13887","title":"A Survey of Dimension Estimation Methods","created":"2025-07-18","cited_by_count":12},{"id":"2509.02565","title":"Understanding sparse autoencoder scaling in the presence of feature manifolds","created":"2025-09-02","cited_by_count":11},{"id":"2602.14687","title":"SynthSAEBench: Evaluating Sparse Autoencoders on Scalable Realistic Synthetic Data","created":"2026-02-16","cited_by_count":11},{"id":"1706.03149","title":"An Expectation-Maximization Algorithm for the Fractal Inverse Problem","created":"2017-06-09","cited_by_count":3},{"id":"2502.14924","title":"A Tale of Two Structures: Do LLMs Capture the Fractal Complexity of Language?","created":"2025-02-19","cited_by_count":3},{"id":"2602.05184","title":"Towards Worst-Case Guarantees with Scale-Aware Interpretability","created":"2026-02-05","cited_by_count":3},{"id":"2504.20197","title":"Representation Learning on a Random Lattice","created":"2025-04-28","cited_by_count":2},{"id":"2509.03780","title":"Natural Latents: Latent Variables Stable Across Ontologies","created":"2025-09-04","cited_by_count":2},{"id":"2512.13853","title":"Dropout Neural Network Training Viewed from a Percolation Perspective","created":"2025-12-15","cited_by_count":2}],"next_cursor":null}