{"list":"other","total":53,"rows":[{"id":"2303.08774","title":"GPT-4 Technical Report","created":"2023-03-15","cited_by_count":18396},{"id":"2407.21783","title":"The Llama 3 Herd of Models","created":"2024-07-31","cited_by_count":14715},{"id":"2302.04761","title":"Toolformer: Language Models Can Teach Themselves to Use Tools","created":"2023-02-09","cited_by_count":4182},{"id":"2307.03172","title":"Lost in the Middle: How Language Models Use Long Contexts","created":"2023-07-06","cited_by_count":3455},{"id":"2101.00027","title":"The Pile: An 800GB Dataset of Diverse Text for Language Modeling","created":"2020-12-31","cited_by_count":2411},{"id":"1803.03635","title":"The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks","created":"2018-03-09","cited_by_count":2262},{"id":"2411.15594","title":"A Survey on LLM-as-a-Judge","created":"2024-11-23","cited_by_count":1423},{"id":"2102.09690","title":"Calibrate Before Use: Improving Few-Shot Performance of Language Models","created":"2021-02-19","cited_by_count":1392},{"id":"2404.06654","title":"RULER: What's the Real Context Size of Your Long-Context Language Models?","created":"2024-04-09","cited_by_count":1346},{"id":"2210.03350","title":"Measuring and Narrowing the Compositionality Gap in Language Models","created":"2022-10-07","cited_by_count":1075},{"id":"1506.06724","title":"Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Books","created":"2015-06-22","cited_by_count":1043},{"id":"2209.10652","title":"Toy Models of Superposition","created":"2022-09-21","cited_by_count":971},{"id":"1603.05279","title":"XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks","created":"2016-03-16","cited_by_count":849},{"id":"2301.05217","title":"Progress measures for grokking via mechanistic interpretability","created":"2023-01-12","cited_by_count":839},{"id":"1503.02406","title":"Deep Learning and the Information Bottleneck Principle","created":"2015-03-09","cited_by_count":802},{"id":"1909.00512","title":"How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddings","created":"2019-09-02","cited_by_count":784},{"id":"1606.06160","title":"DoReFa-Net: Training Low Bitwidth Convolutional Neural Networks with Low Bitwidth Gradients","created":"2016-06-20","cited_by_count":569},{"id":"1906.11300","title":"Benign Overfitting in Linear Regression","created":"2019-06-26","cited_by_count":549},{"id":"1805.06085","title":"PACT: Parameterized Clipping Activation for Quantized Neural Networks","created":"2018-05-16","cited_by_count":467},{"id":"2404.14082","title":"Mechanistic Interpretability for AI Safety -- A Review","created":"2024-04-22","cited_by_count":422},{"id":"2006.07710","title":"The Pitfalls of Simplicity Bias in Neural Networks","created":"2020-06-13","cited_by_count":351},{"id":"2310.15916","title":"In-Context Learning Creates Task Vectors","created":"2023-10-24","cited_by_count":312},{"id":"2402.00157","title":"Large Language Models for Mathematical Reasoning: Progresses and Challenges","created":"2024-01-31","cited_by_count":284},{"id":"2311.08298","title":"A Survey of Confidence Estimation and Calibration in Large Language Models","created":"2023-11-14","cited_by_count":256},{"id":"1907.12009","title":"Representation Degeneration Problem in Training Natural Language Generation Models","created":"2019-07-28","cited_by_count":255},{"id":"2305.14160","title":"Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning","created":"2023-05-23","cited_by_count":236},{"id":"2401.06102","title":"Patchscopes: A Unifying Framework for Inspecting Hidden Representations of Language Models","created":"2024-01-11","cited_by_count":235},{"id":"2405.14860","title":"Not All Language Model Features Are One-Dimensionally Linear","created":"2024-05-23","cited_by_count":212},{"id":"2406.11944","title":"Transcoders Find Interpretable LLM Feature Circuits","created":"2024-06-17","cited_by_count":200},{"id":"2004.03333","title":"Binary Neural Networks: A Survey","created":"2020-03-31","cited_by_count":190},{"id":"2501.16496","title":"Open Problems in Mechanistic Interpretability","created":"2025-01-27","cited_by_count":179},{"id":"2103.10427","title":"The Low-Rank Simplicity Bias in Deep Networks","created":"2021-03-18","cited_by_count":154},{"id":"1911.09464","title":"Quantization Networks","created":"2019-11-21","cited_by_count":153},{"id":"2305.09731","title":"What In-Context Learning \"Learns\" In-Context: Disentangling Task Recognition and Task Learning","created":"2023-05-16","cited_by_count":152},{"id":"2404.16811","title":"Make Your LLM Fully Utilize the Context","created":"2024-04-25","cited_by_count":119},{"id":"2305.18887","title":"How Does Information Bottleneck Help Deep Learning?","created":"2023-05-30","cited_by_count":93},{"id":"2305.19148","title":"Mitigating Label Biases for In-context Learning","created":"2023-05-28","cited_by_count":89},{"id":"2305.13673","title":"Physics of Language Models: Part 1, Learning Hierarchical Language Structures","created":"2023-05-23","cited_by_count":83},{"id":"2401.12143","title":"Anisotropy Is Inherent to Self-Attention in Transformers","created":"2024-01-22","cited_by_count":63},{"id":"2505.18235","title":"The Origins of Representation Manifolds in Large Language Models","created":"2025-05-23","cited_by_count":51},{"id":"2403.01509","title":"Fantastic Semantics and Where to Find Them: Investigating Which Layers of Generative LLMs Reflect Lexical Semantics","created":"2024-03-03","cited_by_count":44},{"id":"2406.17759","title":"Interpreting Attention Layer Outputs with Sparse Autoencoders","created":"2024-06-25","cited_by_count":43},{"id":"2412.18626","title":"Why Do Large Language Models (LLMs) Struggle to Count Letters?","created":"2024-12-19","cited_by_count":38},{"id":"2408.05451","title":"Mathematical Models of Computation in Superposition","created":"2024-08-10","cited_by_count":35},{"id":"2311.09198","title":"Never Lost in the Middle: Mastering Long-Context Question Answering with Position-Agnostic Decompositional Training","created":"2023-11-15","cited_by_count":32},{"id":"2502.12170","title":"MUDDFormer: Breaking Residual Bottlenecks in Transformers via Multiway Dynamic Dense Connections","created":"2025-02-13","cited_by_count":31},{"id":"2410.09695","title":"Can In-context Learning Really Generalize to Out-of-distribution Tasks?","created":"2024-10-13","cited_by_count":23},{"id":"2405.14804","title":"Can LLMs Solve longer Math Word Problems Better?","created":"2024-05-23","cited_by_count":22},{"id":"2410.04468","title":"Revisiting In-context Learning Inference Circuit in Large Language Models","created":"2024-10-06","cited_by_count":17},{"id":"2406.04216","title":"What Do Language Models Learn in Context? The Structured Task Hypothesis","created":"2024-06-06","cited_by_count":13},{"id":"2404.01278","title":"BiPer: Binary Neural Networks using a Periodic Function","created":"2024-04-01","cited_by_count":9},{"id":"2305.04712","title":"High-Dimensional Smoothed Entropy Estimation via Dimensionality Reduction","created":"2023-05-08","cited_by_count":7},{"id":"2501.15708","title":"StaICC: Standardized Evaluation for Classification Task in In-context Learning","created":"2025-01-27","cited_by_count":2}],"next_cursor":null}