{"total":110,"rows":[{"id":"2411.04330","title":"Scaling Laws for Precision","created":"2024-11-07","cited_by_count":95,"area":null},{"id":"2505.24832","title":"How much do language models memorize?","created":"2025-05-30","cited_by_count":61,"area":null},{"id":"2407.17817","title":"Demystifying Verbatim Memorization in Large Language Models","created":"2024-07-25","cited_by_count":56,"area":null},{"id":"2407.15017","title":"Knowledge Mechanisms in Large Language Models: A Survey and Perspective","created":"2024-07-22","cited_by_count":51,"area":null},{"id":"2412.06538","title":"Understanding Factual Recall in Transformers via Associative Memories","created":"2024-12-09","cited_by_count":51,"area":null},{"id":"2410.08527","title":"Scaling Laws for Predicting Downstream Performance in LLMs","created":"2024-10-11","cited_by_count":48,"area":null},{"id":"2509.26030","title":"Muon Outperforms Adam in Tail-End Associative Memory Learning","created":"2025-09-30","cited_by_count":46,"area":null},{"id":"2505.20674","title":"PonderLM: Pretraining Language Models to Ponder in Continuous Space","created":"2025-05-27","cited_by_count":44,"area":null},{"id":"2503.21676","title":"How do language models learn facts? Dynamics, curricula and hallucinations","created":"2025-03-27","cited_by_count":37,"area":null},{"id":"2406.15720","title":"Scaling Laws for Fact Memorization of Large Language Models","created":"2024-06-22","cited_by_count":33,"area":null},{"id":"2512.17351","title":"Physics of Language Models: Part 4.1, Architecture Design and the Magic of Canon Layers","created":"2025-12-19","cited_by_count":33,"area":null},{"id":"2408.10718","title":"CodeJudge-Eval: Can Large Language Models be Good Judges in Code Understanding?","created":"2024-08-20","cited_by_count":30,"area":null},{"id":"2412.06540","title":"Sloth: scaling laws for LLM skills to predict multi-benchmark performance across families","created":"2024-12-09","cited_by_count":24,"area":null},{"id":"2502.11196","title":"How Do LLMs Acquire New Knowledge? A Knowledge Circuits Perspective on Continual Pre-Training","created":"2025-02-16","cited_by_count":23,"area":null},{"id":"2501.01956","title":"Metadata Conditioning Accelerates Language Model Pre-training","created":"2025-01-03","cited_by_count":22,"area":null},{"id":"2407.12327","title":"Spectra: Surprising Effectiveness of Pretraining Ternary Language Models at Scale","created":"2024-07-17","cited_by_count":21,"area":null},{"id":"2502.06857","title":"Gemstones: A Model Suite for Multi-Faceted Scaling Laws","created":"2025-02-07","cited_by_count":20,"area":null},{"id":"2405.09220","title":"ALPINE: Unveiling the Planning Capability of Autoregressive Learning in Language Models","created":"2024-05-15","cited_by_count":18,"area":null},{"id":"2410.04368","title":"Algorithmic Capabilities of Random Transformers","created":"2024-10-06","cited_by_count":17,"area":null},{"id":"2410.01380","title":"Knowledge Entropy Decay during Language Model Pretraining Hinders New Knowledge Acquisition","created":"2024-10-02","cited_by_count":16,"area":null},{"id":"2505.18091","title":"Data Mixing Can Induce Phase Transitions in Knowledge Acquisition","created":"2025-05-23","cited_by_count":16,"area":null},{"id":"2406.18400","title":"Do LLMs dream of elephants (when told not to)? Latent concept association and associative memory in transformers","created":"2024-06-26","cited_by_count":15,"area":null},{"id":"2411.13476","title":"When Precision Meets Position: BFloat16 Breaks Down RoPE in Long-Context Training","created":"2024-11-20","cited_by_count":15,"area":null},{"id":"2501.05078","title":"Analyzing Memorization in Large Language Models through the Lens of Model Attribution","created":"2025-01-09","cited_by_count":14,"area":null},{"id":"2502.07760","title":"Scalable Fingerprinting of Large Language Models","created":"2025-02-11","cited_by_count":14,"area":null},{"id":"2603.26554","title":"Sharp Capacity Scaling of Spectral Optimizers in Learning Associative Memory","created":"2026-03-27","cited_by_count":14,"area":null},{"id":"2405.21070","title":"What Makes CLIP More Robust to Long-Tailed Pre-Training Data? A Controlled Study for Transferable Insights","created":"2024-05-31","cited_by_count":13,"area":null},{"id":"2510.24963","title":"Language Model Behavioral Phases are Consistent Across Architecture, Training Data, and Scale","created":"2025-10-28","cited_by_count":13,"area":null},{"id":"2411.04920","title":"Enabling LLM Knowledge Analysis via Extensive Materialization","created":"2024-11-07","cited_by_count":12,"area":null},{"id":"2502.13178","title":"Benchmarking Post-Training Quantization in LLMs: Comprehensive Taxonomy, Unified Evaluation, and Comparative Analysis","created":"2025-02-18","cited_by_count":12,"area":null},{"id":"2505.15962","title":"Pre-training Limited Memory Language Models with Internal and External Knowledge","created":"2025-05-21","cited_by_count":12,"area":null},{"id":"2502.06604","title":"Do we really have to filter out random noise in pre-training data for language models?","created":"2025-02-10","cited_by_count":11,"area":null},{"id":"2405.13209","title":"Investigating Symbolic Capabilities of Large Language Models","created":"2024-05-21","cited_by_count":8,"area":null},{"id":"2510.00537","title":"Spectral Scaling Laws in Language Models: How Effectively Do Feed-Forward Networks Use Their Latent Space?","created":"2025-10-01","cited_by_count":8,"area":null},{"id":"2605.19407","title":"A Bitter Lesson for Data Filtering","created":"2026-05-19","cited_by_count":8,"area":null},{"id":"2509.16596","title":"Analyzing the Effects of Supervised Fine-Tuning on Model Knowledge from Token and Parameter Levels","created":"2025-09-20","cited_by_count":7,"area":null},{"id":"2603.04956","title":"WaterSIC: Information-Theoretically (Near) Optimal Linear Layer Quantization","created":"2026-03-05","cited_by_count":7,"area":null},{"id":"2502.12051","title":"How to Upscale Neural Networks with Scaling Law? A Survey and Practical Guidelines","created":"2025-02-17","cited_by_count":5,"area":null},{"id":"2505.00147","title":"AdaptMI: Adaptive Skill-based In-context Math Instruction for Small Language Models","created":"2025-04-30","cited_by_count":5,"area":null},{"id":"2602.01605","title":"Universal Redundancies in Time Series Foundation Models","created":"2026-02-02","cited_by_count":5,"area":null},{"id":"2410.03040","title":"Geometry is All You Need: A Unified Taxonomy of Matrix and Tensor Factorization for Compression of Generative Language Models","created":"2024-10-03","cited_by_count":4,"area":null},{"id":"2410.05052","title":"Initialization of Large Language Models via Reparameterization to Mitigate Loss Spikes","created":"2024-10-07","cited_by_count":4,"area":null},{"id":"2411.01663","title":"Unlocking the Theory Behind Scaling 1-Bit Neural Networks","created":"2024-11-03","cited_by_count":4,"area":null},{"id":"2502.04066","title":"Beyond Scaling: Measuring and Predicting the Upper Bound of Knowledge Retention in Language Model Pre-Training","created":"2025-02-06","cited_by_count":4,"area":null},{"id":"2506.18233","title":"Beyond Parameters: Exploring Virtual Logic Depth for Scaling Laws","created":"2025-06-23","cited_by_count":4,"area":null},{"id":"2602.15156","title":"Panini: Continual Learning in Token Space via Structured Memory","created":"2026-02-16","cited_by_count":4,"area":null},{"id":"2605.09724","title":"Model Capacity Determines Grokking through Competing Memorisation and Generalisation Speeds","created":"2026-05-10","cited_by_count":4,"area":null},{"id":"2606.24998","title":"Internal Data Repetition Destroys Language Models","created":"2026-06-23","cited_by_count":4,"area":null},{"id":"2502.01717","title":"Choose Your Model Size: Any Compression of Large Language Models Without Re-Computation","created":"2025-02-03","cited_by_count":3,"area":null},{"id":"2504.17562","title":"When Does Metadata Conditioning (NOT) Work for Language Model Pre-Training? A Study with Context-Free Grammars","created":"2025-04-24","cited_by_count":3,"area":null},{"id":"2506.07458","title":"KScope: A Framework for Characterizing the Knowledge Status of Language Models","created":"2025-06-09","cited_by_count":3,"area":null},{"id":"2511.07318","title":"When Bias Pretends to Be Truth: How Spurious Correlations Undermine Hallucination Detection in LLMs","created":"2025-11-10","cited_by_count":3,"area":null},{"id":"2604.08519","title":"Cram Less to Fit More: Training Data Pruning Improves Memorization of Facts","created":"2026-04-09","cited_by_count":3,"area":null},{"id":"2605.05189","title":"Sharp Capacity Thresholds in Linear Associative Memory: From Top-1 Retrieval to Tail-Average Learning","created":"2026-05-06","cited_by_count":3,"area":null},{"id":"2605.10129","title":"Synthetic Pre-Pre-Training Improves Language Model Robustness to Noisy Pre-Training Data","created":"2026-05-11","cited_by_count":3,"area":null},{"id":"2408.06087","title":"Building Decision Making Models Through Language Model Regime","created":"2024-08-12","cited_by_count":2,"area":null},{"id":"2409.13421","title":"State space models, emergence, and ergodicity: How many parameters are needed for stable predictions?","created":"2024-09-20","cited_by_count":2,"area":null},{"id":"2409.15825","title":"60 Data Points are Sufficient to Fine-Tune LLMs for Question-Answering","created":"2024-09-24","cited_by_count":2,"area":null},{"id":"2502.05159","title":"A Lightweight Method to Disrupt Memorized Sequences in LLM","created":"2025-02-07","cited_by_count":2,"area":null},{"id":"2503.12899","title":"A Semantic-based Optimization Approach for Repairing LLMs: Case Study on Code Generation","created":"2025-03-17","cited_by_count":2,"area":null},{"id":"2504.01450","title":"CASCADE Your Datasets for Cross-Mode Knowledge Retrieval of Language Models","created":"2025-04-02","cited_by_count":2,"area":null},{"id":"2505.04528","title":"Beyond Theorem Proving: Formulation, Framework and Benchmark for Formal Problem-Solving","created":"2025-05-07","cited_by_count":2,"area":null},{"id":"2505.14070","title":"Enhancing LLMs via High-Knowledge Data Selection","created":"2025-05-20","cited_by_count":2,"area":null},{"id":"2506.12312","title":"Perspective on Utilizing Foundation Models for Laboratory Automation in Materials Research","created":"2025-06-14","cited_by_count":2,"area":null},{"id":"2507.02529","title":"RetrySQL: text-to-SQL training with retry data for self-correcting query generation","created":"2025-07-03","cited_by_count":2,"area":null},{"id":"2512.22088","title":"Unifying Learning Dynamics and Generalization in Transformers Scaling Law","created":"2025-12-26","cited_by_count":2,"area":null},{"id":"2602.00906","title":"Hallucination is a Consequence of Space-Optimality: A Rate-Distortion Theorem for Membership Testing","created":"2026-01-31","cited_by_count":2,"area":null},{"id":"2607.12962","title":"Form, Not Content? A Preregistered, Placebo-Controlled Evaluation of Learned Error-Conditioned Self-Repair Through Prompts and Weights in Frozen Small Code Models","created":"2026-07-14","cited_by_count":2,"area":null},{"id":"2407.10949","title":"Representing Rule-based Chatbots with Transformers","created":"2024-07-15","cited_by_count":1,"area":null},{"id":"2407.15425","title":"Empirical Capacity Model for Self-Attention Neural Networks","created":"2024-07-22","cited_by_count":1,"area":null},{"id":"2501.05787","title":"MARS6: A Small and Robust Hierarchical-Codec Text-to-Speech Model","created":"2025-01-10","cited_by_count":1,"area":null},{"id":"2502.14583","title":"A Theory for Conditional Generative Modeling on Multiple Data Sources","created":"2025-02-20","cited_by_count":1,"area":null},{"id":"2504.06823","title":"Open Problems and a Hypothetical Path Forward in LLM Knowledge Paradigms","created":"2025-04-09","cited_by_count":1,"area":null},{"id":"2505.16570","title":"URLs Help, Topics Guide: Understanding Metadata Utility in LLM Training","created":"2025-05-22","cited_by_count":1,"area":null},{"id":"2505.18369","title":"Small Models, Smarter Learning: The Power of Joint Task Training","created":"2025-05-23","cited_by_count":1,"area":null},{"id":"2510.24208","title":"Beyond Neural Incompatibility: Cross-Scale Knowledge Transfer in Language Models through Latent Semantic Alignment","created":"2025-10-28","cited_by_count":1,"area":null},{"id":"2605.00610","title":"Decouple before Integration: Test-time Synthesis of SFT and RLVR Task Vectors","created":"2026-05-01","cited_by_count":1,"area":null},{"id":"2605.10795","title":"Factual recall in linear associative memories: sharp asymptotics and mechanistic insights","created":"2026-05-11","cited_by_count":1,"area":null},{"id":"2605.12426","title":"Geometric Factual Recall in Transformers","created":"2026-05-12","cited_by_count":1,"area":null},{"id":"2605.18732","title":"Predictable Confabulations: Factual Recall by LLMs Scales with Model Size and Topic Frequency","created":"2026-05-18","cited_by_count":1,"area":null},{"id":"2605.27564","title":"The Future of Facts: Tracing the Factual Generation-Verification Gap","created":"2026-05-26","cited_by_count":1,"area":null},{"id":"2605.27774","title":"Fine-Tuning Dynamics of In-Context Factual Recall in Transformers","created":"2026-05-26","cited_by_count":1,"area":null},{"id":"2607.10034","title":"MLPs are Hebbians: Constructing Efficient Fact-Storing MLPs for Transformers","created":"2026-07-10","cited_by_count":1,"area":null},{"id":"2607.21351","title":"How Much Can a LoRA Adapter Memorize? Measuring Adapter Capacity in Bits","created":"2026-07-23","cited_by_count":1,"area":null},{"id":"2608.20873","title":"In-Cell Learning: Language Models That Update Their Own Weights in Sequence Without Changing the File They Ship","created":"2026-08-21","cited_by_count":1,"area":null},{"id":"2406.10660","title":"DIEKAE: Difference Injection for Efficient Knowledge Augmentation and Editing of Large Language Models","created":"2024-06-15","cited_by_count":0,"area":null},{"id":"2502.03490","title":"Examining Two Hop Reasoning Through Information Content Scaling","created":"2025-02-05","cited_by_count":0,"area":null},{"id":"2506.05639","title":"FictionalQA: A Dataset for Studying Memorization and Knowledge Acquisition","created":"2025-06-05","cited_by_count":0,"area":null},{"id":"2507.03300","title":"LRM-1B: Towards Large Routing Model","created":"2025-07-04","cited_by_count":0,"area":null},{"id":"2511.02626","title":"Understanding New-Knowledge-Induced Factual Hallucinations in LLMs: Analysis and Interpretation","created":"2025-11-04","cited_by_count":0,"area":null},{"id":"2511.03407","title":"Overcoming the Generalization Limits of SLM Finetuning for Shape-Based Extraction of Datatype and Object Properties","created":"2025-11-05","cited_by_count":0,"area":null},{"id":"2511.21613","title":"Beyond URLs: Metadata Diversity and Position for Efficient LLM Pretraining","created":"2025-11-26","cited_by_count":0,"area":null},{"id":"2512.07522","title":"LIME: Making LLM Data More Efficient with Linguistic Metadata Embeddings","created":"2025-12-08","cited_by_count":0,"area":null},{"id":"2601.10926","title":"Selecting Language Models for Social Science: Start Small, Start Open, and Validate","created":"2026-01-16","cited_by_count":0,"area":null},{"id":"2602.01227","title":"Supervised Fine-Tuning Needs to Unlock the Potential of Token Priority","created":"2026-02-01","cited_by_count":0,"area":null},{"id":"2602.03949","title":"Semantic Rate Distortion and Posterior Design: Compute Constraints, Multimodality, and Strategic Inference","created":"2026-02-03","cited_by_count":0,"area":null},{"id":"2603.22213","title":"SPA: A Simple but Tough-to-Beat Baseline for Knowledge Injection","created":"2026-03-23","cited_by_count":0,"area":null},{"id":"2606.00570","title":"Revisiting Parameter-Based Knowledge Editing in Large Language Models: Theoretical Limits and Empirical Evidence","created":"2026-05-30","cited_by_count":0,"area":null},{"id":"2606.23271","title":"Scaling LLM Knowledge Boundaries via Distribution-Optimized Synthesis","created":"2026-06-22","cited_by_count":0,"area":null},{"id":"2607.08393","title":"Towards Mechanistically Understanding Why Memorized Knowledge Fails to Generalize in Large Language Model Finetuning","created":"2026-07-09","cited_by_count":0,"area":null}],"next_cursor":"100"}