{"total":180,"rows":[{"id":"2401.01286","title":"A Comprehensive Study of Knowledge Editing for Large Language Models","created":"2024-01-02","cited_by_count":163,"area":null},{"id":"2404.05405","title":"Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Laws","created":"2024-04-08","cited_by_count":144,"area":null},{"id":"2411.04905","title":"OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models","created":"2024-11-07","cited_by_count":130,"area":null},{"id":"2311.12786","title":"Mechanistically analyzing the effects of fine-tuning on procedurally defined tasks","created":"2023-11-21","cited_by_count":115,"area":null},{"id":"2406.11813","title":"How Do Large Language Models Acquire Factual Knowledge During Pretraining?","created":"2024-06-17","cited_by_count":90,"area":null},{"id":"2506.10943","title":"Self-Adapting Language Models","created":"2025-06-12","cited_by_count":84,"area":null},{"id":"2407.07263","title":"Reuse, Don't Retrain: A Recipe for Continued Pretraining of Language Models","created":"2024-07-09","cited_by_count":72,"area":null},{"id":"2410.14716","title":"A Systematic Survey on Large Language Models for Algorithm Design","created":"2024-10-11","cited_by_count":69,"area":null},{"id":"2410.13835","title":"Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMs","created":"2024-10-17","cited_by_count":56,"area":null},{"id":"2402.12847","title":"Instruction-tuned Language Models are Better Knowledge Learners","created":"2024-02-20","cited_by_count":55,"area":null},{"id":"2407.15017","title":"Knowledge Mechanisms in Large Language Models: A Survey and Perspective","created":"2024-07-22","cited_by_count":51,"area":null},{"id":"2501.00070","title":"ICLR: In-Context Learning of Representations","created":"2024-12-29","cited_by_count":50,"area":null},{"id":"2403.13799","title":"Reverse Training to Nurse the Reversal Curse","created":"2024-03-20","cited_by_count":49,"area":null},{"id":"2502.01563","title":"Massive Values in Self-Attention Modules are the Key to Contextual Knowledge Understanding","created":"2025-02-03","cited_by_count":47,"area":null},{"id":"2412.02975","title":"Theoretical limitations of multi-layer Transformer","created":"2024-12-04","cited_by_count":45,"area":null},{"id":"2406.19470","title":"Changing Answer Order Can Decrease MMLU Accuracy","created":"2024-06-27","cited_by_count":42,"area":null},{"id":"2412.12472","title":"Knowledge Boundary of Large Language Models: A Survey","created":"2024-12-17","cited_by_count":40,"area":null},{"id":"2412.13337","title":"Unveiling the Secret Recipe: A Guide For Supervised Fine-Tuning Small LLMs","created":"2024-12-17","cited_by_count":40,"area":null},{"id":"2503.21676","title":"How do language models learn facts? Dynamics, curricula and hallucinations","created":"2025-03-27","cited_by_count":37,"area":null},{"id":"2404.01475","title":"Are large language models superhuman chemists?","created":"2024-04-01","cited_by_count":34,"area":null},{"id":"2406.15720","title":"Scaling Laws for Fact Memorization of Large Language Models","created":"2024-06-22","cited_by_count":33,"area":null},{"id":"2512.17351","title":"Physics of Language Models: Part 4.1, Architecture Design and the Magic of Canon Layers","created":"2025-12-19","cited_by_count":33,"area":null},{"id":"2406.10881","title":"Teaching Large Language Models to Express Knowledge Boundary from Their Own Signals","created":"2024-06-16","cited_by_count":32,"area":null},{"id":"2406.14785","title":"Understanding Finetuning for Factual Knowledge Extraction","created":"2024-06-20","cited_by_count":32,"area":null},{"id":"2503.10084","title":"Why Prompt Design Matters and Works: A Complexity Analysis of Prompt Search Space in LLMs","created":"2025-03-13","cited_by_count":31,"area":null},{"id":"2404.01019","title":"Source-Aware Training Enables Knowledge Attribution in Language Models","created":"2024-04-01","cited_by_count":30,"area":null},{"id":"2509.14786","title":"Pre-training under infinite compute","created":"2025-09-18","cited_by_count":29,"area":null},{"id":"2312.00678","title":"The Efficiency Spectrum of Large Language Models: An Algorithmic Survey","created":"2023-12-01","cited_by_count":26,"area":null},{"id":"2411.05877","title":"Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass","created":"2024-11-08","cited_by_count":26,"area":null},{"id":"2505.17863","title":"The emergence of sparse attention: impact of data distribution and benefits of repetition","created":"2025-05-23","cited_by_count":25,"area":null},{"id":"2501.02950","title":"Key-value memory in the brain","created":"2025-01-06","cited_by_count":24,"area":null},{"id":"2502.11196","title":"How Do LLMs Acquire New Knowledge? A Knowledge Circuits Perspective on Continual Pre-Training","created":"2025-02-16","cited_by_count":23,"area":null},{"id":"2311.12997","title":"Compositional Capabilities of Autoregressive Transformers: A Study on Synthetic, Interpretable Tasks","created":"2023-11-21","cited_by_count":22,"area":null},{"id":"2510.23081","title":"A Survey on LLM Mid-Training","created":"2025-10-27","cited_by_count":21,"area":null},{"id":"2311.02105","title":"Making Harmful Behaviors Unlearnable for Large Language Models","created":"2023-11-02","cited_by_count":20,"area":null},{"id":"2407.06249","title":"CodeUpdateArena: Benchmarking Knowledge Editing on API Updates","created":"2024-07-08","cited_by_count":19,"area":null},{"id":"2410.17194","title":"Representation Shattering in Transformers: A Synthetic Study with Knowledge Editing","created":"2024-10-22","cited_by_count":19,"area":null},{"id":"2405.09220","title":"ALPINE: Unveiling the Planning Capability of Autoregressive Learning in Language Models","created":"2024-05-15","cited_by_count":18,"area":null},{"id":"2406.06326","title":"Self-Tuning: Instructing LLMs to Effectively Acquire New Knowledge through Self-Teaching","created":"2024-06-10","cited_by_count":17,"area":null},{"id":"2410.16090","title":"Analysing the Residual Stream of Language Models Under Knowledge Conflicts","created":"2024-10-21","cited_by_count":17,"area":null},{"id":"2410.01380","title":"Knowledge Entropy Decay during Language Model Pretraining Hinders New Knowledge Acquisition","created":"2024-10-02","cited_by_count":16,"area":null},{"id":"2505.18091","title":"Data Mixing Can Induce Phase Transitions in Knowledge Acquisition","created":"2025-05-23","cited_by_count":16,"area":null},{"id":"2403.09053","title":"Towards a theory of model distillation","created":"2024-03-14","cited_by_count":15,"area":null},{"id":"2406.18400","title":"Do LLMs dream of elephants (when told not to)? Latent concept association and associative memory in transformers","created":"2024-06-26","cited_by_count":15,"area":null},{"id":"2410.08414","title":"Understanding the Interplay between Parametric and Contextual Knowledge for Large Language Models","created":"2024-10-10","cited_by_count":15,"area":null},{"id":"2510.14751","title":"Beyond Multi-Token Prediction: Pretraining LLMs with Future Summaries","created":"2025-10-16","cited_by_count":15,"area":null},{"id":"2408.04532","title":"How Transformers Utilize Multi-Head Attention in In-Context Learning? A Case Study on Sparse Linear Regression","created":"2024-08-08","cited_by_count":14,"area":null},{"id":"2410.03249","title":"How Much Can We Forget about Data Contamination?","created":"2024-10-04","cited_by_count":14,"area":null},{"id":"2501.05078","title":"Analyzing Memorization in Large Language Models through the Lens of Model Attribution","created":"2025-01-09","cited_by_count":14,"area":null},{"id":"2406.02394","title":"Pattern Recognition or Medical Knowledge? The Problem with Multiple-Choice Questions in Medicine","created":"2024-06-04","cited_by_count":13,"area":null},{"id":"2508.09494","title":"Learning Facts at Scale with Active Reading","created":"2025-08-13","cited_by_count":13,"area":null},{"id":"2603.04964","title":"Replaying pre-training data improves fine-tuning","created":"2026-03-05","cited_by_count":13,"area":null},{"id":"2409.14057","title":"Co-occurrence is not Factual Association in Language Models","created":"2024-09-21","cited_by_count":12,"area":null},{"id":"2505.15962","title":"Pre-training Limited Memory Language Models with Internal and External Knowledge","created":"2025-05-21","cited_by_count":12,"area":null},{"id":"2510.14865","title":"Midtraining Bridges Pretraining and Posttraining Distributions","created":"2025-10-16","cited_by_count":12,"area":null},{"id":"2603.01097","title":"Understanding LoRA as Knowledge Memory: An Empirical Analysis","created":"2026-03-01","cited_by_count":12,"area":null},{"id":"2406.03345","title":"Feature contamination: Neural networks learn uncorrelated features and fail to generalize","created":"2024-06-05","cited_by_count":11,"area":null},{"id":"2410.07041","title":"Emergent properties with repeated examples","created":"2024-10-09","cited_by_count":11,"area":null},{"id":"2410.18808","title":"Delving into the Reversal Curse: How Far Can Large Language Models Generalize?","created":"2024-10-24","cited_by_count":11,"area":null},{"id":"2412.10675","title":"Chasing Progress, Not Perfection: Revisiting Strategies for End-to-End LLM Plan Generation","created":"2024-12-14","cited_by_count":11,"area":null},{"id":"2502.06604","title":"Do we really have to filter out random noise in pre-training data for language models?","created":"2025-02-10","cited_by_count":11,"area":null},{"id":"2502.19573","title":"Do Large Language Models Know How Much They Know?","created":"2025-02-26","cited_by_count":11,"area":null},{"id":"2505.15807","title":"The Atlas of In-Context Learning: How Attention Heads Shape In-Context Retrieval Augmentation","created":"2025-05-21","cited_by_count":11,"area":null},{"id":"2405.19010","title":"Evaluating the External and Parametric Knowledge Fusion of Large Language Models","created":"2024-05-29","cited_by_count":9,"area":null},{"id":"2504.19636","title":"Fitness Landscape of Large Language Model-Assisted Automated Algorithm Search","created":"2025-04-28","cited_by_count":9,"area":null},{"id":"2403.07805","title":"Beyond Memorization: The Challenge of Random Memory Access in Language Models","created":"2024-03-12","cited_by_count":8,"area":null},{"id":"2411.07175","title":"Continual Memorization of Factoids in Language Models","created":"2024-11-11","cited_by_count":8,"area":null},{"id":"2503.05919","title":"From Style to Facts: Mapping the Boundaries of Knowledge Injection with Finetuning","created":"2025-03-07","cited_by_count":8,"area":null},{"id":"2503.07003","title":"Large Language Models Often Say One Thing and Do Another","created":"2025-03-10","cited_by_count":8,"area":null},{"id":"2504.09522","title":"How new data permeates LLM knowledge and how to dilute it","created":"2025-04-13","cited_by_count":8,"area":null},{"id":"2507.05346","title":"LoRA-Augmented Generation (LAG) for Knowledge-Intensive Language Tasks","created":"2025-07-07","cited_by_count":8,"area":null},{"id":"2512.01970","title":"Atomic Skills are the Prerequisite: When Reinforcement Learning Synthesizes Compositional Reasoning, and When It Only Amplifies","created":"2025-12-01","cited_by_count":8,"area":null},{"id":"2404.12957","title":"Towards Reliable Latent Knowledge Estimation in LLMs: Zero-Prompt Many-Shot Based Factual Knowledge Extraction","created":"2024-04-19","cited_by_count":7,"area":null},{"id":"2506.02921","title":"A Controllable Examination for Long-Context Language Models","created":"2025-06-03","cited_by_count":7,"area":null},{"id":"2510.00184","title":"Why Can't Transformers Learn Multiplication? Reverse-Engineering Reveals Long-Range Dependency Pitfalls","created":"2025-09-30","cited_by_count":7,"area":null},{"id":"2603.18534","title":"Data-efficient pre-training by scaling synthetic megadocs","created":"2026-03-19","cited_by_count":7,"area":null},{"id":"2402.12170","title":"Where is the answer? Investigating Positional Bias in Language Model Knowledge Extraction","created":"2024-02-16","cited_by_count":6,"area":null},{"id":"2407.16724","title":"Structure-aware Domain Knowledge Injection for Large Language Models","created":"2024-07-23","cited_by_count":6,"area":null},{"id":"2412.13626","title":"LIFT: Improving Long Context Understanding Through Long Input Fine-Tuning","created":"2024-12-18","cited_by_count":6,"area":null},{"id":"2509.23383","title":"Train Once, Answer All: Many Pretraining Experiments for the Cost of One","created":"2025-09-27","cited_by_count":6,"area":null},{"id":"2503.21383","title":"Controlling Large Language Model with Latent Actions","created":"2025-03-27","cited_by_count":5,"area":null},{"id":"2504.16273","title":"From Promising Capability to Pervasive Bias: Assessing Large Language Models for Emergency Department Triage","created":"2025-04-22","cited_by_count":5,"area":null},{"id":"2512.04695","title":"TRINITY: An Evolved LLM Coordinator","created":"2025-12-04","cited_by_count":5,"area":null},{"id":"2601.09445","title":"Where Knowledge Collides: A Mechanistic Study of Intra-Memory Knowledge Conflict in Language Models","created":"2026-01-14","cited_by_count":5,"area":null},{"id":"2411.01663","title":"Unlocking the Theory Behind Scaling 1-Bit Neural Networks","created":"2024-11-03","cited_by_count":4,"area":null},{"id":"2502.04066","title":"Beyond Scaling: Measuring and Predicting the Upper Bound of Knowledge Retention in Language Model Pre-Training","created":"2025-02-06","cited_by_count":4,"area":null},{"id":"2502.10760","title":"Why is prompting hard? Understanding prompts on binary sequence predictors","created":"2025-02-15","cited_by_count":4,"area":null},{"id":"2504.10902","title":"Leveraging Submodule Linearity Enhances Task Arithmetic Performance in LLMs","created":"2025-04-15","cited_by_count":4,"area":null},{"id":"2505.22945","title":"OWL: Probing Cross-Lingual Recall of Memorized Texts via World Literature","created":"2025-05-28","cited_by_count":4,"area":null},{"id":"2506.03490","title":"Beyond Memorization: A Rigorous Evaluation Framework for Medical Knowledge Editing","created":"2025-06-04","cited_by_count":4,"area":null},{"id":"2507.03648","title":"Disentangling the Roles of Representation and Selection in Data Pruning","created":"2025-07-04","cited_by_count":4,"area":null},{"id":"2510.02370","title":"How Training Data Shapes the Use of Parametric and In-Context Knowledge in Language Models","created":"2025-09-29","cited_by_count":4,"area":null},{"id":"2511.05933","title":"Reinforcement Learning Improves Traversal of Parametric Knowledge in LLMs","created":"2025-11-08","cited_by_count":4,"area":null},{"id":"2605.15156","title":"MeMo: Memory as a Model","created":"2026-05-14","cited_by_count":4,"area":null},{"id":"2402.13731","title":"Cracking Factual Knowledge: A Comprehensive Analysis of Degenerate Knowledge Neurons in Large Language Models","created":"2024-02-21","cited_by_count":3,"area":null},{"id":"2411.00686","title":"Latent Paraphrasing: Perturbation on Layers Improves Knowledge Injection in Language Models","created":"2024-11-01","cited_by_count":3,"area":null},{"id":"2411.19456","title":"Beyond Surface Structure: A Causal Assessment of LLMs' Comprehension Ability","created":"2024-11-29","cited_by_count":3,"area":null},{"id":"2502.19410","title":"Less or More: Towards Glanceable Explanations for LLM Recommendations Using Ultra-Small Devices","created":"2025-02-26","cited_by_count":3,"area":null},{"id":"2503.10542","title":"Language Models, Graph Searching, and Supervision Adulteration: When More Supervision is Less and How to Make More More","created":"2025-03-13","cited_by_count":3,"area":null},{"id":"2506.07458","title":"KScope: A Framework for Characterizing the Knowledge Status of Language Models","created":"2025-06-09","cited_by_count":3,"area":null}],"next_cursor":"100"}