{"total":270,"rows":[{"id":"2501.17161","title":"SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training","created":"2025-01-28","cited_by_count":672,"area":"lr"},{"id":"2412.14093","title":"Alignment faking in large language models","created":"2024-12-18","cited_by_count":360,"area":"alignment"},{"id":"2402.16837","title":"Do Large Language Models Latently Perform Multi-Hop Reasoning?","created":"2024-02-26","cited_by_count":169,"area":"lr"},{"id":"2401.01286","title":"A Comprehensive Study of Knowledge Editing for Large Language Models","created":"2024-01-02","cited_by_count":163,"area":null},{"id":"2404.05405","title":"Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Laws","created":"2024-04-08","cited_by_count":144,"area":null},{"id":"2511.18397","title":"Natural Emergent Misalignment from Reward Hacking in Production RL","created":"2025-11-23","cited_by_count":136,"area":"alignment"},{"id":"2411.04905","title":"OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models","created":"2024-11-07","cited_by_count":130,"area":null},{"id":"2311.12786","title":"Mechanistically analyzing the effects of fine-tuning on procedurally defined tasks","created":"2023-11-21","cited_by_count":115,"area":null},{"id":"2407.20311","title":"Physics of Language Models: Part 2.1, Grade-School Math and the Hidden Reasoning Process","created":"2024-07-29","cited_by_count":108,"area":"lr"},{"id":"2508.14444","title":"NVIDIA Nemotron Nano 2: An Accurate and Efficient Hybrid Mamba-Transformer Reasoning Model","created":"2025-08-20","cited_by_count":108,"area":"lr"},{"id":"2309.17167","title":"DyVal: Dynamic Evaluation of Large Language Models for Reasoning Tasks","created":"2023-09-29","cited_by_count":101,"area":"lr"},{"id":"2402.14409","title":"Tug-of-War Between Knowledge: Exploring and Resolving Knowledge Conflicts in Retrieval-Augmented Language Models","created":"2024-02-22","cited_by_count":93,"area":"rag"},{"id":"2406.11813","title":"How Do Large Language Models Acquire Factual Knowledge During Pretraining?","created":"2024-06-17","cited_by_count":90,"area":null},{"id":"2506.10943","title":"Self-Adapting Language Models","created":"2025-06-12","cited_by_count":84,"area":null},{"id":"2412.16075","title":"Formal Mathematical Reasoning: A New Frontier in AI","created":"2024-12-20","cited_by_count":81,"area":"lr"},{"id":"2406.10890","title":"RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models","created":"2024-06-16","cited_by_count":78,"area":"safety"},{"id":"2312.07000","title":"Alignment for Honesty","created":"2023-12-12","cited_by_count":74,"area":"alignment"},{"id":"2407.07263","title":"Reuse, Don't Retrain: A Recipe for Continued Pretraining of Language Models","created":"2024-07-09","cited_by_count":72,"area":null},{"id":"2410.14716","title":"A Systematic Survey on Large Language Models for Algorithm Design","created":"2024-10-11","cited_by_count":69,"area":null},{"id":"2402.01586","title":"TrustAgent: Towards Safe and Trustworthy LLM-based Agents","created":"2024-02-02","cited_by_count":64,"area":"agents"},{"id":"2410.15999","title":"Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering","created":"2024-10-21","cited_by_count":63,"area":"mechinterp"},{"id":"2410.15226","title":"On the Diversity of Synthetic Data and its Impact on Training Large Language Models","created":"2024-10-19","cited_by_count":59,"area":"synth"},{"id":"2410.13835","title":"Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMs","created":"2024-10-17","cited_by_count":56,"area":null},{"id":"2402.12847","title":"Instruction-tuned Language Models are Better Knowledge Learners","created":"2024-02-20","cited_by_count":55,"area":null},{"id":"2506.08446","title":"A Survey on Large Language Models for Mathematical Reasoning","created":"2025-06-10","cited_by_count":52,"area":"lr"},{"id":"2407.15017","title":"Knowledge Mechanisms in Large Language Models: A Survey and Perspective","created":"2024-07-22","cited_by_count":51,"area":null},{"id":"2408.16293","title":"Physics of Language Models: Part 2.2, How to Learn From Mistakes on Grade-School Math Problems","created":"2024-08-29","cited_by_count":50,"area":"lr"},{"id":"2501.00070","title":"ICLR: In-Context Learning of Representations","created":"2024-12-29","cited_by_count":50,"area":null},{"id":"2403.13799","title":"Reverse Training to Nurse the Reversal Curse","created":"2024-03-20","cited_by_count":49,"area":null},{"id":"2502.01563","title":"Massive Values in Self-Attention Modules are the Key to Contextual Knowledge Understanding","created":"2025-02-03","cited_by_count":47,"area":null},{"id":"2412.02975","title":"Theoretical limitations of multi-layer Transformer","created":"2024-12-04","cited_by_count":45,"area":null},{"id":"2411.13504","title":"Disentangling Memory and Reasoning Ability in Large Language Models","created":"2024-11-20","cited_by_count":44,"area":"lr"},{"id":"2406.19470","title":"Changing Answer Order Can Decrease MMLU Accuracy","created":"2024-06-27","cited_by_count":42,"area":null},{"id":"2410.12896","title":"A Survey on Data Synthesis and Augmentation for Large Language Models","created":"2024-10-16","cited_by_count":41,"area":"synth"},{"id":"2412.12472","title":"Knowledge Boundary of Large Language Models: A Survey","created":"2024-12-17","cited_by_count":40,"area":null},{"id":"2412.13337","title":"Unveiling the Secret Recipe: A Guide For Supervised Fine-Tuning Small LLMs","created":"2024-12-17","cited_by_count":40,"area":null},{"id":"2505.00661","title":"On the generalization of language models from in-context learning and finetuning: a controlled study","created":"2025-05-01","cited_by_count":40,"area":"lr"},{"id":"2406.03445","title":"Pre-trained Large Language Models Use Fourier Features to Compute Addition","created":"2024-06-05","cited_by_count":39,"area":"lr"},{"id":"2501.15915","title":"Parametric Retrieval Augmented Generation","created":"2025-01-27","cited_by_count":38,"area":"rag"},{"id":"2503.21676","title":"How do language models learn facts? Dynamics, curricula and hallucinations","created":"2025-03-27","cited_by_count":37,"area":null},{"id":"2604.07822","title":"Loop, Think, & Generalize: Implicit Reasoning in Recurrent-Depth Transformers","created":"2026-04-09","cited_by_count":37,"area":"lr"},{"id":"2409.12568","title":"InfiMM-WebMath-40B: Advancing Multimodal Pre-Training for Enhanced Mathematical Reasoning","created":"2024-09-19","cited_by_count":36,"area":"lr"},{"id":"2404.01475","title":"Are large language models superhuman chemists?","created":"2024-04-01","cited_by_count":34,"area":null},{"id":"2406.15720","title":"Scaling Laws for Fact Memorization of Large Language Models","created":"2024-06-22","cited_by_count":33,"area":null},{"id":"2501.12835","title":"Adaptive Retrieval Without Self-Knowledge? Bringing Uncertainty Back Home","created":"2025-01-22","cited_by_count":33,"area":"rag"},{"id":"2512.17351","title":"Physics of Language Models: Part 4.1, Architecture Design and the Magic of Canon Layers","created":"2025-12-19","cited_by_count":33,"area":null},{"id":"2406.10881","title":"Teaching Large Language Models to Express Knowledge Boundary from Their Own Signals","created":"2024-06-16","cited_by_count":32,"area":null},{"id":"2406.14785","title":"Understanding Finetuning for Factual Knowledge Extraction","created":"2024-06-20","cited_by_count":32,"area":null},{"id":"2410.19730","title":"Counting Ability of Large Language Models and Impact of Tokenization","created":"2024-10-25","cited_by_count":32,"area":"lr"},{"id":"2503.10084","title":"Why Prompt Design Matters and Works: A Complexity Analysis of Prompt Search Space in LLMs","created":"2025-03-13","cited_by_count":31,"area":null},{"id":"2404.01019","title":"Source-Aware Training Enables Knowledge Attribution in Language Models","created":"2024-04-01","cited_by_count":30,"area":null},{"id":"2410.17215","title":"MiniPLM: Knowledge Distillation for Pre-Training Language Models","created":"2024-10-22","cited_by_count":29,"area":"distill"},{"id":"2509.14786","title":"Pre-training under infinite compute","created":"2025-09-18","cited_by_count":29,"area":null},{"id":"2312.00678","title":"The Efficiency Spectrum of Large Language Models: An Algorithmic Survey","created":"2023-12-01","cited_by_count":26,"area":null},{"id":"2411.05877","title":"Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass","created":"2024-11-08","cited_by_count":26,"area":null},{"id":"2503.23895","title":"Dynamic Parametric Retrieval Augmented Generation for Test-time Knowledge Enhancement","created":"2025-03-31","cited_by_count":25,"area":"rag"},{"id":"2505.17863","title":"The emergence of sparse attention: impact of data distribution and benefits of repetition","created":"2025-05-23","cited_by_count":25,"area":null},{"id":"2501.02950","title":"Key-value memory in the brain","created":"2025-01-06","cited_by_count":24,"area":null},{"id":"2409.18786","title":"A Survey on the Honesty of Large Language Models","created":"2024-09-27","cited_by_count":23,"area":"alignment"},{"id":"2502.11196","title":"How Do LLMs Acquire New Knowledge? A Knowledge Circuits Perspective on Continual Pre-Training","created":"2025-02-16","cited_by_count":23,"area":null},{"id":"2311.12997","title":"Compositional Capabilities of Autoregressive Transformers: A Study on Synthetic, Interpretable Tasks","created":"2023-11-21","cited_by_count":22,"area":null},{"id":"2410.19034","title":"Mixture of Parrots: Experts improve memorization more than reasoning","created":"2024-10-24","cited_by_count":21,"area":"moe"},{"id":"2508.10975","title":"BeyondWeb: Lessons from Scaling Synthetic Data for Trillion-scale Pretraining","created":"2025-08-14","cited_by_count":21,"area":"synth"},{"id":"2510.23081","title":"A Survey on LLM Mid-Training","created":"2025-10-27","cited_by_count":21,"area":null},{"id":"2602.06176","title":"Large Language Model Reasoning Failures","created":"2026-02-05","cited_by_count":21,"area":"lr"},{"id":"2311.02105","title":"Making Harmful Behaviors Unlearnable for Large Language Models","created":"2023-11-02","cited_by_count":20,"area":null},{"id":"2502.13913","title":"How Do LLMs Perform Two-Hop Reasoning in Context?","created":"2025-02-19","cited_by_count":20,"area":"lr"},{"id":"2407.06249","title":"CodeUpdateArena: Benchmarking Knowledge Editing on API Updates","created":"2024-07-08","cited_by_count":19,"area":null},{"id":"2410.17194","title":"Representation Shattering in Transformers: A Synthetic Study with Knowledge Editing","created":"2024-10-22","cited_by_count":19,"area":null},{"id":"2501.09213","title":"FineMedLM-o1: Enhancing Medical Knowledge Reasoning Ability of LLM from Supervised Fine-Tuning to Test-Time Training","created":"2025-01-16","cited_by_count":19,"area":"lr"},{"id":"2508.05612","title":"Shuffle-R1: Efficient RL framework for Multimodal Large Language Models via Data-centric Dynamic Shuffle","created":"2025-08-07","cited_by_count":19,"area":"lr"},{"id":"2405.09220","title":"ALPINE: Unveiling the Planning Capability of Autoregressive Learning in Language Models","created":"2024-05-15","cited_by_count":18,"area":null},{"id":"2406.06326","title":"Self-Tuning: Instructing LLMs to Effectively Acquire New Knowledge through Self-Teaching","created":"2024-06-10","cited_by_count":17,"area":null},{"id":"2410.16090","title":"Analysing the Residual Stream of Language Models Under Knowledge Conflicts","created":"2024-10-21","cited_by_count":17,"area":null},{"id":"2505.07859","title":"Product of Experts with LLMs: Boosting Performance on ARC Is a Matter of Perspective","created":"2025-05-08","cited_by_count":17,"area":"lr"},{"id":"2312.05253","title":"DiSK: A Diffusion Model for Structured Knowledge","created":"2023-12-08","cited_by_count":16,"area":"diffusion"},{"id":"2409.09239","title":"Autoregressive + Chain of Thought = Recurrent: Recurrence's Role in Language Models' Computability and a Revisit of Recurrent Transformer","created":"2024-09-14","cited_by_count":16,"area":"lr"},{"id":"2410.01380","title":"Knowledge Entropy Decay during Language Model Pretraining Hinders New Knowledge Acquisition","created":"2024-10-02","cited_by_count":16,"area":null},{"id":"2505.18091","title":"Data Mixing Can Induce Phase Transitions in Knowledge Acquisition","created":"2025-05-23","cited_by_count":16,"area":null},{"id":"2403.09053","title":"Towards a theory of model distillation","created":"2024-03-14","cited_by_count":15,"area":null},{"id":"2406.18400","title":"Do LLMs dream of elephants (when told not to)? Latent concept association and associative memory in transformers","created":"2024-06-26","cited_by_count":15,"area":null},{"id":"2410.08414","title":"Understanding the Interplay between Parametric and Contextual Knowledge for Large Language Models","created":"2024-10-10","cited_by_count":15,"area":null},{"id":"2510.14751","title":"Beyond Multi-Token Prediction: Pretraining LLMs with Future Summaries","created":"2025-10-16","cited_by_count":15,"area":null},{"id":"2408.04532","title":"How Transformers Utilize Multi-Head Attention in In-Context Learning? A Case Study on Sparse Linear Regression","created":"2024-08-08","cited_by_count":14,"area":null},{"id":"2410.03249","title":"How Much Can We Forget about Data Contamination?","created":"2024-10-04","cited_by_count":14,"area":null},{"id":"2501.05078","title":"Analyzing Memorization in Large Language Models through the Lens of Model Attribution","created":"2025-01-09","cited_by_count":14,"area":null},{"id":"2507.11662","title":"Let's Think in Two Steps: Mitigating Agreement Bias in MLLMs with Self-Grounded Verification","created":"2025-07-15","cited_by_count":14,"area":"lr"},{"id":"2406.02394","title":"Pattern Recognition or Medical Knowledge? The Problem with Multiple-Choice Questions in Medicine","created":"2024-06-04","cited_by_count":13,"area":null},{"id":"2501.14002","title":"Advancing Mathematical Reasoning in Language Models: The Impact of Problem-Solving Data, Data Synthesis Methods, and Training Stages","created":"2025-01-23","cited_by_count":13,"area":"lr"},{"id":"2508.09494","title":"Learning Facts at Scale with Active Reading","created":"2025-08-13","cited_by_count":13,"area":null},{"id":"2603.04964","title":"Replaying pre-training data improves fine-tuning","created":"2026-03-05","cited_by_count":13,"area":null},{"id":"2409.14057","title":"Co-occurrence is not Factual Association in Language Models","created":"2024-09-21","cited_by_count":12,"area":null},{"id":"2502.20592","title":"Multi2: Multi-Agent Test-Time Scalable Framework for Multi-Document Processing","created":"2025-02-27","cited_by_count":12,"area":"lr"},{"id":"2503.04036","title":"Robust Data Watermarking in Language Models by Injecting Fictitious Knowledge","created":"2025-03-06","cited_by_count":12,"area":"safety"},{"id":"2505.15962","title":"Pre-training Limited Memory Language Models with Internal and External Knowledge","created":"2025-05-21","cited_by_count":12,"area":null},{"id":"2510.14865","title":"Midtraining Bridges Pretraining and Posttraining Distributions","created":"2025-10-16","cited_by_count":12,"area":null},{"id":"2603.01097","title":"Understanding LoRA as Knowledge Memory: An Empirical Analysis","created":"2026-03-01","cited_by_count":12,"area":null},{"id":"2605.10923","title":"Dynamic Skill Lifecycle Management for Agentic Reinforcement Learning","created":"2026-05-11","cited_by_count":12,"area":"agents"},{"id":"2406.03345","title":"Feature contamination: Neural networks learn uncorrelated features and fail to generalize","created":"2024-06-05","cited_by_count":11,"area":null},{"id":"2410.07041","title":"Emergent properties with repeated examples","created":"2024-10-09","cited_by_count":11,"area":null}],"next_cursor":"100"}