{"total":116,"rows":[{"id":"2510.05381","title":"Context Length Alone Hurts LLM Performance Despite Perfect Retrieval","created":"2025-10-06","cited_by_count":127,"area":null},{"id":"2410.06205","title":"Round and Round We Go! What makes Rotary Positional Encodings useful?","created":"2024-10-08","cited_by_count":115,"area":null},{"id":"2410.16179","title":"MagicPIG: LSH Sampling for Efficient LLM Generation","created":"2024-10-21","cited_by_count":111,"area":null},{"id":"2405.00208","title":"A Primer on the Inner Workings of Transformer-based Language Models","created":"2024-04-30","cited_by_count":85,"area":null},{"id":"2409.03752","title":"Attention Heads of Large Language Models: A Survey","created":"2024-09-05","cited_by_count":67,"area":null},{"id":"2406.01563","title":"LoFiT: Localized Fine-tuning on LLM Representations","created":"2024-06-03","cited_by_count":57,"area":null},{"id":"2502.02770","title":"Twilight: Adaptive Attention Sparsity with Hierarchical Top-$p$ Pruning","created":"2025-02-04","cited_by_count":49,"area":null},{"id":"2410.01104","title":"Softmax is not Enough (for Sharp Size Generalisation)","created":"2024-10-01","cited_by_count":46,"area":null},{"id":"2406.14909","title":"Mixture of Attention Spans: Optimizing LLM Inference Efficiency with Heterogeneous Sliding-Window Lengths","created":"2024-06-21","cited_by_count":44,"area":null},{"id":"2502.12671","title":"Baichuan-M1: Pushing the Medical Capability of Large Language Models","created":"2025-02-18","cited_by_count":43,"area":null},{"id":"2412.16545","title":"Attention Entropy is a Key Factor: An Analysis of Parallel Context Encoding with Full-attention-based Pre-trained Language Models","created":"2024-12-21","cited_by_count":26,"area":null},{"id":"2410.18860","title":"DeCoRe: Decoding by Contrasting Retrieval Heads to Mitigate Hallucinations","created":"2024-10-24","cited_by_count":25,"area":null},{"id":"2502.11812","title":"Towards Understanding Fine-Tuning Mechanisms of LLMs via Circuit Analysis","created":"2025-02-17","cited_by_count":20,"area":null},{"id":"2502.14258","title":"Does Time Have Its Place? Temporal Heads: Where Language Models Recall Time-specific Information","created":"2025-02-20","cited_by_count":15,"area":null},{"id":"2504.18574","title":"Understanding the Skill Gap in Recurrent Language Models: The Role of the Gather-and-Aggregate Mechanism","created":"2025-04-22","cited_by_count":15,"area":null},{"id":"2410.08703","title":"On the token distance modeling ability of higher RoPE attention dimension","created":"2024-10-11","cited_by_count":13,"area":null},{"id":"2504.13752","title":"Learning to Attribute with Attention","created":"2025-04-18","cited_by_count":13,"area":null},{"id":"2512.12087","title":"BLASST: Dynamic BLocked Attention Sparsity via Softmax Thresholding","created":"2025-12-12","cited_by_count":13,"area":null},{"id":"2505.12969","title":"Calm-Whisper: Reduce Whisper Hallucination On Non-Speech By Calming Crazy Heads Down","created":"2025-05-19","cited_by_count":12,"area":null},{"id":"2411.02688","title":"On the Loss of Context-awareness in General Instruction Fine-tuning","created":"2024-11-05","cited_by_count":11,"area":null},{"id":"2503.02502","title":"LADM: Long-context Training Data Selection with Attention-based Dependency Measurement for LLMs","created":"2025-03-04","cited_by_count":11,"area":null},{"id":"2505.15807","title":"The Atlas of In-Context Learning: How Attention Heads Shape In-Context Retrieval Augmentation","created":"2025-05-21","cited_by_count":11,"area":null},{"id":"2501.01059","title":"Dynamic Attention-Guided Context Decoding for Mitigating Context Faithfulness Hallucinations in Large Language Models","created":"2025-01-02","cited_by_count":9,"area":null},{"id":"2503.23306","title":"Focus Directions Make Your Language Models Pay More Attention to Relevant Contexts","created":"2025-03-30","cited_by_count":9,"area":null},{"id":"2502.02095","title":"LongDPO: Unlock Better Long-form Generation Abilities for LLMs via Critique-augmented Stepwise Information","created":"2025-02-04","cited_by_count":8,"area":null},{"id":"2510.05396","title":"Scalable In-context Ranking with Generative Models","created":"2025-10-06","cited_by_count":8,"area":null},{"id":"2603.01281","title":"Spectral Attention Steering for Prompt Highlighting","created":"2026-03-01","cited_by_count":8,"area":null},{"id":"2605.15514","title":"RoPE Distinguishes Neither Positions Nor Tokens in Long Contexts, Provably","created":"2026-05-15","cited_by_count":8,"area":null},{"id":"2410.02499","title":"Defining Knowledge: Bridging Epistemology and Large Language Models","created":"2024-10-03","cited_by_count":7,"area":null},{"id":"2505.11254","title":"Delta Attention: Fast and Accurate Sparse Attention Inference by Delta Correction","created":"2025-05-16","cited_by_count":7,"area":null},{"id":"2508.02215","title":"LeanK: Learnable K Cache Channel Pruning for Efficient Decoding","created":"2025-08-04","cited_by_count":7,"area":null},{"id":"2505.17134","title":"LongMagpie: A Self-synthesis Method for Generating Large-scale Long-context Instructions","created":"2025-05-22","cited_by_count":6,"area":null},{"id":"2505.21785","title":"Born a Transformer -- Always a Transformer? On the Effect of Pretraining on Architectural Abilities","created":"2025-05-27","cited_by_count":6,"area":null},{"id":"2505.22630","title":"Stochastic Chameleons: Irrelevant Context Hallucinations Reveal Class-Based (Mis)Generalization in LLMs","created":"2025-05-28","cited_by_count":6,"area":null},{"id":"2510.13796","title":"The Mechanistic Emergence of Symbol Grounding in Language Models","created":"2025-10-15","cited_by_count":6,"area":null},{"id":"2602.12192","title":"Query-focused and Memory-aware Reranker for Long Context Processing","created":"2026-02-12","cited_by_count":6,"area":null},{"id":"2410.02115","title":"L-CiteEval: Do Long-Context Models Truly Leverage Context for Responding?","created":"2024-10-03","cited_by_count":5,"area":null},{"id":"2502.09647","title":"Unveiling Simplicities of Attention: Adaptive Long-Context Head Identification","created":"2025-02-11","cited_by_count":5,"area":null},{"id":"2502.11276","title":"The Rotary Position Embedding May Cause Dimension Inefficiency in Attention Heads for Long-Distance Retrieval","created":"2025-02-16","cited_by_count":5,"area":null},{"id":"2506.01872","title":"Is Extending Modality The Right Path Towards Omni-Modality?","created":"2025-06-02","cited_by_count":5,"area":null},{"id":"2510.05862","title":"Revisiting Long-context Modeling from Context Denoising Perspective","created":"2025-10-07","cited_by_count":5,"area":null},{"id":"2601.17367","title":"Elastic Attention: Test-time Adaptive Sparsity Ratios for Efficient Transformers","created":"2026-01-24","cited_by_count":5,"area":null},{"id":"2602.19969","title":"ReAttn: Improving Attention-based Re-ranking via Attention Re-weighting","created":"2026-02-23","cited_by_count":5,"area":null},{"id":"2503.08057","title":"Odysseus Navigates the Sirens' Song: Dynamic Focus Decoding for Factual and Diverse Open-Ended Text Generation","created":"2025-03-11","cited_by_count":4,"area":null},{"id":"2505.10063","title":"CAFE: Retrieval Head-based Coarse-to-Fine Information Seeking to Enhance Multi-Document QA Capability","created":"2025-05-15","cited_by_count":4,"area":null},{"id":"2506.17052","title":"From Concepts to Components: Concept-Agnostic Attention Module Discovery in Transformers","created":"2025-06-20","cited_by_count":4,"area":null},{"id":"2509.19372","title":"Representation-based Broad Hallucination Detectors Fail to Generalize Out of Distribution","created":"2025-09-19","cited_by_count":4,"area":null},{"id":"2512.17452","title":"KV Admission: Learning What to Write for Efficient Long-Context LLM Inference","created":"2025-12-19","cited_by_count":4,"area":null},{"id":"2603.26380","title":"Switch Attention: Towards Dynamic and Fine-grained Hybrid Transformers","created":"2026-03-27","cited_by_count":4,"area":null},{"id":"2406.02536","title":"Mitigate Position Bias in Large Language Models via Scaling a Single Dimension","created":"2024-06-04","cited_by_count":3,"area":null},{"id":"2411.00066","title":"Interpretable Next-token Prediction via the Generalized Induction Head","created":"2024-10-31","cited_by_count":3,"area":null},{"id":"2412.18811","title":"DCIS: Efficient Length Extrapolation of LLMs via Divide-and-Conquer Scaling Factor Search","created":"2024-12-25","cited_by_count":3,"area":null},{"id":"2512.03494","title":"A Preliminary Study on the Promises and Challenges of Native Top-$k$ Sparse Attention","created":"2025-12-03","cited_by_count":3,"area":null},{"id":"2602.19239","title":"Attention Deficits in Language Models: Causal Explanations for Procedural Hallucinations","created":"2026-02-22","cited_by_count":3,"area":null},{"id":"2604.11322","title":"Do LLMs Know Tool Irrelevance? Demystifying Structural Alignment Bias in Tool Invocations","created":"2026-04-13","cited_by_count":3,"area":null},{"id":"2609.02986","title":"Modern Transformers Are Implicit Hybrids: From Functional Differentiation to Principled Hybrid Architecture Design","created":"2026-09-02","cited_by_count":3,"area":null},{"id":"2501.15225","title":"SEAL: Scaling to Emphasize Attention for Long-Context Retrieval","created":"2025-01-25","cited_by_count":2,"area":null},{"id":"2502.08436","title":"From Haystack to Needle: Label Space Reduction for Zero-shot Classification","created":"2025-02-12","cited_by_count":2,"area":null},{"id":"2502.13542","title":"Activation-aware Probe-Query: Effective Key-Value Retrieval for Long-Context LLMs Inference","created":"2025-02-19","cited_by_count":2,"area":null},{"id":"2507.09875","title":"Function Induction and Task Generalization: An Interpretability Study with Off-by-One Addition","created":"2025-07-14","cited_by_count":2,"area":null},{"id":"2508.20353","title":"DFAMS: Dynamic-flow guided Federated Alignment based Multi-prototype Search","created":"2025-08-28","cited_by_count":2,"area":null},{"id":"2509.04897","title":"PLaMo 2 Technical Report","created":"2025-09-05","cited_by_count":2,"area":null},{"id":"2510.22866","title":"Interpreting and Mitigating Unwanted Uncertainty in LLMs","created":"2025-10-26","cited_by_count":2,"area":null},{"id":"2510.25979","title":"AttnCache: Accelerating Self-Attention Inference for LLM Prefill via Attention Cache","created":"2025-10-29","cited_by_count":2,"area":null},{"id":"2602.00861","title":"Multi-Head Attention Is a Multi-Player Game","created":"2026-01-31","cited_by_count":2,"area":null},{"id":"2602.11162","title":"Retrieval Heads are Dynamic","created":"2026-01-07","cited_by_count":2,"area":null},{"id":"2602.22175","title":"DySCO: Dynamic Attention-Scaling Decoding for Long-Context Language Models","created":"2026-02-25","cited_by_count":2,"area":null},{"id":"2603.10705","title":"PRISM-$\\Delta$: Differential Subspace Steering for Prompt Highlighting in Large Language Models","created":"2026-03-11","cited_by_count":2,"area":null},{"id":"2604.01432","title":"Are Finer Citations Always Better? Rethinking Granularity for Attributed Generation","created":"2026-04-01","cited_by_count":2,"area":null},{"id":"2604.22345","title":"Preference Heads in Large Language Models: A Mechanistic Framework for Interpretable Personalization","created":"2026-04-24","cited_by_count":2,"area":null},{"id":"2607.01538","title":"Can Language Models Actually Retrieve In-Context? Drowning in Documents at Million Token Scale","created":"2026-07-01","cited_by_count":2,"area":null},{"id":"2607.12963","title":"The Illusion of Robustness: Aggregate Accuracy Hides Prediction Flips under Task-Irrelevant Context","created":"2026-07-14","cited_by_count":2,"area":null},{"id":"2509.18762","title":"When Long Helps Short: How Context Length in Supervised Fine-tuning Affects Behavior of Large Language Models","created":"2025-09-23","cited_by_count":1,"area":null},{"id":"2601.07422","title":"Two Pathways to Truthfulness: On the Intrinsic Encoding of LLM Hallucinations","created":"2026-01-12","cited_by_count":1,"area":null},{"id":"2601.17702","title":"S$^3$-Attention:Attention-Aligned Endogenous Retrieval for Memory-Bounded Long-Context Inference","created":"2026-01-25","cited_by_count":1,"area":null},{"id":"2604.02650","title":"Revealing the Learning Dynamics of Long-Context Continual Pre-training","created":"2026-04-03","cited_by_count":1,"area":null},{"id":"2604.06393","title":"ART: Attention Replacement Technique to Improve Factuality in LLMs","created":"2026-04-07","cited_by_count":1,"area":null},{"id":"2605.11744","title":"Training-Inference Consistent Segmented Execution for Long-Context LLMs","created":"2026-05-12","cited_by_count":1,"area":null},{"id":"2606.03022","title":"Hallucinations as Orthogonal Noise: Inference-Time Manifold Alignment via Dynamic Contextual Orthogonalization","created":"2026-06-02","cited_by_count":1,"area":null},{"id":"2607.07670","title":"Does Bielik Know What It Doesn't Know? Activation Dispersion Separates Entity Familiarity from Factual Reliability Across Model Scale","created":"2026-07-08","cited_by_count":1,"area":null},{"id":"2607.09415","title":"Self-Guided Test-Time Training for Long-Context LLMs","created":"2026-07-10","cited_by_count":1,"area":null},{"id":"2608.12218","title":"Information Abundance Paradox: Long-Context Training Undermines Parametric Knowledge","created":"2026-08-12","cited_by_count":1,"area":null},{"id":"2407.17678","title":"S2-Attention: Hardware-Aware Context Sharding Among Attention Heads","created":"2024-07-25","cited_by_count":0,"area":null},{"id":"2505.24292","title":"Mind the Quote: Enabling Quotation-Aware Dialogue in LLMs via Plug-and-Play Modules","created":"2025-05-30","cited_by_count":0,"area":null},{"id":"2508.00285","title":"Enhancing Trustworthy Clinical Diagnosis Decision-Making in Large Language Models via Etiology-Aware Attention Supervision","created":"2025-08-01","cited_by_count":0,"area":null},{"id":"2510.08341","title":"Post-Norm can Resharpen Attention","created":"2025-10-09","cited_by_count":0,"area":null},{"id":"2602.08237","title":"Document Reconstruction Unlocks Scalable Long-Context RLVR","created":"2026-02-09","cited_by_count":0,"area":null},{"id":"2602.09486","title":"Listen to the Layers: Mitigating Hallucinations with Inter-Layer Disagreement","created":"2026-02-10","cited_by_count":0,"area":null},{"id":"2602.17526","title":"The Anxiety of Influence: Bloom Filters in Transformer Attention Heads","created":"2026-02-19","cited_by_count":0,"area":null},{"id":"2602.22453","title":"Identifying Crucial Attention Heads for Multilingual Language Models: Retrieval and Retrieval-Transition Heads","created":"2026-02-25","cited_by_count":0,"area":null},{"id":"2604.07394","title":"Flux Attention: Context-Aware Hybrid Attention for Efficient LLMs Inference","created":"2026-04-08","cited_by_count":0,"area":null},{"id":"2604.24608","title":"Learning to Route Queries to Heads for Attention-based Re-ranking with Large Language Models","created":"2026-04-27","cited_by_count":0,"area":null},{"id":"2605.30022","title":"Give it Space! Explicit Disentangling of Positional and Semantic Representations in Encoders","created":"2026-05-28","cited_by_count":0,"area":null},{"id":"2606.21249","title":"Does RoPE Prevent or Degrade Retrieval Heads? A Mechanistic Analysis Across Model Families","created":"2026-06-19","cited_by_count":0,"area":null},{"id":"2607.01002","title":"Logit-Contribution Scoring Identifies Non-Literal Retrieval Heads","created":"2026-07-01","cited_by_count":0,"area":null},{"id":"2607.01420","title":"MultAttnAttrib: Training-Free Multimodal Attribution in Long Document Question Answering","created":"2026-07-01","cited_by_count":0,"area":null},{"id":"2607.11945","title":"Belief-reality separation lives in routing over a shared value slot in language models","created":"2026-07-11","cited_by_count":0,"area":null},{"id":"2607.17621","title":"Mechanistic Attention Guidance for Agent Memory Refinement","created":"2026-07-20","cited_by_count":0,"area":null},{"id":"2608.03994","title":"When Attention Goes Blind: Numerical Failure in ALiBi Positional Encodings","created":"2026-08-04","cited_by_count":0,"area":null},{"id":"2608.10296","title":"Cracks in the Foundation: Seemingly Minor Architectural Choices Impact Long Context Extension","created":"2026-08-10","cited_by_count":0,"area":null}],"next_cursor":"100"}