{"list":"other","total":71,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"1912.01703","title":"PyTorch: An Imperative Style, High-Performance Deep Learning Library","created":"2019-12-03","cited_by_count":20305},{"id":"2302.13971","title":"LLaMA: Open and Efficient Foundation Language Models","created":"2023-02-27","cited_by_count":14132},{"id":"2110.14168","title":"Training Verifiers to Solve Math Word Problems","created":"2021-10-27","cited_by_count":10109},{"id":"2402.03300","title":"DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models","created":"2024-02-05","cited_by_count":9379},{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"2305.20050","title":"Let's Verify Step by Step","created":"2023-05-31","cited_by_count":3789},{"id":"2305.10601","title":"Tree of Thoughts: Deliberate Problem Solving with Large Language Models","created":"2023-05-17","cited_by_count":3211},{"id":"2202.05262","title":"Locating and Editing Factual Associations in GPT","created":"2022-02-10","cited_by_count":2691},{"id":"2211.00593","title":"Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 small","created":"2022-11-01","cited_by_count":1165},{"id":"2210.03350","title":"Measuring and Narrowing the Compositionality Gap in Language Models","created":"2022-10-07","cited_by_count":1075},{"id":"2203.14465","title":"STaR: Bootstrapping Reasoning With Reasoning","created":"2022-03-28","cited_by_count":940},{"id":"2312.08935","title":"Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations","created":"2023-12-14","cited_by_count":928},{"id":"2305.14992","title":"Reasoning with Language Model is Planning with World Model","created":"2023-05-24","cited_by_count":861},{"id":"2301.05217","title":"Progress measures for grokking via mechanistic interpretability","created":"2023-01-12","cited_by_count":839},{"id":"2305.02301","title":"Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes","created":"2023-05-03","cited_by_count":737},{"id":"2309.12284","title":"MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models","created":"2023-09-21","cited_by_count":735},{"id":"2304.14997","title":"Towards Automated Circuit Discovery for Mechanistic Interpretability","created":"2023-04-28","cited_by_count":724},{"id":"2201.02177","title":"Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets","created":"2022-01-06","cited_by_count":629},{"id":"2210.02406","title":"Decomposed Prompting: A Modular Approach for Solving Complex Tasks","created":"2022-10-05","cited_by_count":558},{"id":"2304.14767","title":"Dissecting Recall of Factual Associations in Auto-Regressive Language Models","created":"2023-04-28","cited_by_count":528},{"id":"2309.05653","title":"MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuning","created":"2023-09-11","cited_by_count":487},{"id":"2408.15240","title":"Generative Verifiers: Reward Modeling as Next-Token Prediction","created":"2024-08-27","cited_by_count":480},{"id":"2309.16042","title":"Towards Best Practices of Activation Patching in Language Models: Metrics and Methods","created":"2023-09-27","cited_by_count":359},{"id":"2502.03373","title":"Demystifying Long Chain-of-Thought Reasoning in LLMs","created":"2025-02-05","cited_by_count":326},{"id":"1705.07809","title":"Information-theoretic analysis of generalization capability of learning algorithms","created":"2017-05-22","cited_by_count":303},{"id":"2305.14795","title":"MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions","created":"2023-05-24","cited_by_count":300},{"id":"2404.02948","title":"PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models","created":"2024-04-03","cited_by_count":269},{"id":"2307.12976","title":"Evaluating the Ripple Effects of Knowledge Editing in Language Models","created":"2023-07-24","cited_by_count":242},{"id":"2401.08967","title":"ReFT: Reasoning with Reinforced Fine-Tuning","created":"2024-01-17","cited_by_count":239},{"id":"2301.13196","title":"Looped Transformers as Programmable Computers","created":"2023-01-30","cited_by_count":237},{"id":"2401.06102","title":"Patchscopes: A Unifying Framework for Inspecting Hidden Representations of Language Models","created":"2024-01-11","cited_by_count":235},{"id":"2305.00586","title":"How does GPT-2 compute greater-than?: Interpreting mathematical abilities in a pre-trained language model","created":"2023-04-30","cited_by_count":202},{"id":"2305.00633","title":"Self-Evaluation Guided Beam Search for Reasoning","created":"2023-05-01","cited_by_count":196},{"id":"2402.16837","title":"Do Large Language Models Latently Perform Multi-Hop Reasoning?","created":"2024-02-26","cited_by_count":169},{"id":"2403.04642","title":"Teaching Large Language Models to Reason with Reinforcement Learning","created":"2024-03-07","cited_by_count":160},{"id":"2403.06963","title":"The pitfalls of next-token prediction","created":"2024-03-11","cited_by_count":160},{"id":"2001.09122","title":"Reasoning About Generalization via Conditional Mutual Information","created":"2020-01-24","cited_by_count":147},{"id":"2404.03683","title":"Stream of Search (SoS): Learning to Search in Language","created":"2024-04-01","cited_by_count":145},{"id":"2209.02535","title":"Analyzing Transformers in Embedding Space","created":"2022-09-06","cited_by_count":132},{"id":"2303.02966","title":"Non-Parametric Outlier Synthesis","created":"2023-03-06","cited_by_count":129},{"id":"2210.14707","title":"Is Out-of-Distribution Detection Learnable?","created":"2022-10-26","cited_by_count":109},{"id":"2310.17191","title":"How do Language Models Bind Entities in Context?","created":"2023-10-26","cited_by_count":108},{"id":"2409.15647","title":"Looped Transformers for Length Generalization","created":"2024-09-24","cited_by_count":99},{"id":"1511.05219","title":"How much does your data exploration overfit? Controlling bias via information usage","created":"2015-11-16","cited_by_count":95},{"id":"2305.15054","title":"A Mechanistic Interpretation of Arithmetic Reasoning in Language Models using Causal Mediation Analysis","created":"2023-05-24","cited_by_count":89},{"id":"2305.15269","title":"Testing the General Deductive Reasoning Capacity of Large Language Models Using OOD Examples","created":"2023-05-24","cited_by_count":84},{"id":"2406.12775","title":"Hopping Too Late: Exploring the Limitations of Large Language Models on Multi-Hop Queries","created":"2024-06-18","cited_by_count":78},{"id":"2404.05221","title":"LLM Reasoners: New Evaluation, Library, and Analysis of Step-by-Step Reasoning with Large Language Models","created":"2024-04-08","cited_by_count":70},{"id":"2305.01651","title":"Can LMs Learn New Entities from Descriptions? Challenges in Propagating Injected Knowledge","created":"2023-05-02","cited_by_count":67},{"id":"2310.03016","title":"Understanding In-Context Learning in Transformers and LLMs by Learning to Learn Discrete Functions","created":"2023-10-04","cited_by_count":63},{"id":"2405.17969","title":"Knowledge Circuits in Pretrained Transformers","created":"2024-05-28","cited_by_count":60},{"id":"2402.11917","title":"A Mechanistic Analysis of a Transformer Trained on a Symbolic Multi-Step Reasoning Task","created":"2024-02-19","cited_by_count":49},{"id":"2402.14328","title":"Understanding and Patching Compositional Reasoning in LLMs","created":"2024-02-22","cited_by_count":46},{"id":"2402.02653","title":"Learning with Mixture of Prototypes for Out-of-Distribution Detection","created":"2024-02-05","cited_by_count":43},{"id":"2501.15602","title":"Rethinking External Slow-Thinking: From Snowball Errors to Probability of Correct Reasoning","created":"2025-01-26","cited_by_count":36},{"id":"2305.13417","title":"VISIT: Visualizing and Interpreting the Semantic Information Flow of Transformers","created":"2023-05-22","cited_by_count":32},{"id":"2410.23743","title":"What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective","created":"2024-10-31","cited_by_count":29},{"id":"2405.04669","title":"Towards a Theoretical Understanding of the 'Reversal Curse' via Training Dynamics","created":"2024-05-07","cited_by_count":27},{"id":"2305.14695","title":"A Causal View of Entity Bias in (Large) Language Models","created":"2023-05-24","cited_by_count":21},{"id":"2309.05605","title":"Memory Injections: Correcting Multi-Hop Reasoning Failures during Inference in Transformer-Based Language Models","created":"2023-09-11","cited_by_count":21},{"id":"2406.13858","title":"Distributional reasoning in LLMs: Parallel reasoning processes in multi-hop reasoning","created":"2024-06-19","cited_by_count":21},{"id":"2406.12288","title":"An Investigation of Neuron Activation as a Unified Lens to Explain Chain-of-Thought Eliciting Arithmetic Reasoning of LLMs","created":"2024-06-18","cited_by_count":20},{"id":"2205.12640","title":"Does Your Model Classify Entities Reasonably? Diagnosing and Mitigating Spurious Correlations in Entity Typing","created":"2022-05-25","cited_by_count":16},{"id":"2310.04921","title":"Crystal: Introspective Reasoners Reinforced with Self-Feedback","created":"2023-10-07","cited_by_count":15},{"id":"2402.11900","title":"Investigating Multi-Hop Factual Shortcuts in Knowledge Editing of Large Language Models","created":"2024-02-19","cited_by_count":14},{"id":"2502.04375","title":"An Analysis for Reasoning Bias of Language Models with Small Initialization","created":"2025-02-05","cited_by_count":13},{"id":"2211.10691","title":"Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States","created":"2022-11-19","cited_by_count":11},{"id":"2410.02247","title":"Theoretical Insights into Fine-Tuning Attention Mechanism: Generalization and Optimization","created":"2024-10-03","cited_by_count":9},{"id":"2410.03011","title":"Towards Understanding the Universality of Transformers for Next-Token Prediction","created":"2024-10-03","cited_by_count":9},{"id":"2406.03768","title":"Enhancing In-Context Learning Performance with just SVD-Based Weight Pruning: A Theoretical Perspective","created":"2024-06-06","cited_by_count":4}],"next_cursor":null}