{"total":32,"rows":[{"id":"2402.10588","title":"Do Llamas Work in English? On the Latent Language of Multilingual Transformers","created":"2024-02-16","cited_by_count":281,"area":null},{"id":"2504.02732","title":"Why do LLMs attend to the first token?","created":"2025-04-03","cited_by_count":127,"area":null},{"id":"2403.00824","title":"Information Flow Routes: Automatically Interpreting Language Models at Scale","created":"2024-02-27","cited_by_count":95,"area":null},{"id":"2405.00208","title":"A Primer on the Inner Workings of Transformer-based Language Models","created":"2024-04-30","cited_by_count":85,"area":null},{"id":"2406.16254","title":"Confidence Regulation Neurons in Language Models","created":"2024-06-24","cited_by_count":57,"area":null},{"id":"2510.06477","title":"Attention Sinks and Compression Valleys in LLMs are Two Sides of the Same Coin","created":"2025-10-07","cited_by_count":52,"area":null},{"id":"2508.02546","title":"What are you sinking? A geometric approach on attention sink","created":"2025-08-04","cited_by_count":28,"area":null},{"id":"2510.22603","title":"Mitigating Attention Sinks and Massive Activations in Audio-Visual Speech Recognition with LLMs","created":"2025-10-26","cited_by_count":11,"area":null},{"id":"2603.11487","title":"Attention Sinks Are Provably Necessary in Softmax Transformers: Evidence from Trigger-Conditional Tasks","created":"2026-03-12","cited_by_count":11,"area":null},{"id":"2411.07176","title":"More Expressive Attention with Negative Weights","created":"2024-11-11","cited_by_count":9,"area":null},{"id":"2511.00280","title":"Calibration Across Layers: Understanding Calibration Evolution in LLMs","created":"2025-10-31","cited_by_count":9,"area":null},{"id":"2412.07334","title":"Frame Representation Hypothesis: Multi-Token LLM Interpretability and Concept-Guided Text Generation","created":"2024-12-10","cited_by_count":5,"area":null},{"id":"2509.09650","title":"All for One: LLMs Solve Mental Math at the Last Token With Information Transferred From Other Tokens","created":"2025-09-11","cited_by_count":5,"area":null},{"id":"2512.22213","title":"On the Existence and Behavior of Secondary Attention Sinks","created":"2025-12-22","cited_by_count":4,"area":null},{"id":"2410.13060","title":"AERO: Entropy-Guided Framework for Private LLM Inference","created":"2024-10-16","cited_by_count":3,"area":null},{"id":"2503.21718","title":"Not a nuisance but a useful heuristic: Outlier dimensions favor frequent tokens in language models","created":"2025-03-27","cited_by_count":3,"area":null},{"id":"2406.09140","title":"Investigating the translation capabilities of Large Language Models trained on parallel data only","created":"2024-06-13","cited_by_count":2,"area":null},{"id":"2604.10027","title":"SinkTrack: Attention Sink based Context Anchoring for Large Language Models","created":"2026-04-11","cited_by_count":2,"area":null},{"id":"2605.08504","title":"A Single Layer to Explain Them All:Understanding Massive Activations in Large Language Models","created":"2026-05-08","cited_by_count":2,"area":null},{"id":"2605.17084","title":"Scale Determines Whether Language Models Organize Representation Geometry for Prediction","created":"2026-05-16","cited_by_count":2,"area":null},{"id":"2606.02288","title":"Massive Spikes in LLMs are Bias Vectors: Mechanistic Uncovering and Spike-Free Quantization","created":"2026-06-01","cited_by_count":2,"area":null},{"id":"2602.01893","title":"Geometric Analysis of Token Selection in Multi-Head Attention","created":"2026-02-02","cited_by_count":1,"area":null},{"id":"2605.06611","title":"The Structural Origin of Attention Sink: Variance Discrepancy, Super Neurons, and Dimension Disparity","created":"2026-05-07","cited_by_count":1,"area":null},{"id":"2606.07502","title":"Your UnEmbedding Matrix is Secretly a Feature Lens for Text Embeddings","created":"2026-06-05","cited_by_count":1,"area":null},{"id":"2609.11716","title":"Why Does Post-Training Quantization Work?","created":"2026-09-10","cited_by_count":1,"area":null},{"id":"2504.04238","title":"Sensitivity Meets Sparsity: The Impact of Extremely Sparse Parameter Patterns on Theory-of-Mind of Large Language Models","created":"2025-04-05","cited_by_count":0,"area":null},{"id":"2604.14722","title":"A Mechanistic Account of Attention Sinks in GPT-2: One Circuit, Broader Implications for Mitigation","created":"2026-04-16","cited_by_count":0,"area":null},{"id":"2606.07604","title":"Contribution Weights: A Geometrical Analysis of Self-Attention Transformers","created":"2026-05-29","cited_by_count":0,"area":null},{"id":"2606.08105","title":"A Unifying View of Attention Sinks: From Mechanisms to Architectural Interventions","created":"2026-06-06","cited_by_count":0,"area":null},{"id":"2609.35630","title":"Which the Eye Fears: Writing with Read-Blindness Explains Massive Activations in Transformers","created":"2026-09-28","cited_by_count":0,"area":null},{"id":"2610.06012","title":"Spectral Geometry of Attention: From Information Routing to Uncertainty","created":"2026-10-05","cited_by_count":0,"area":null},{"id":"2610.16745","title":"Before Attention Sinks Form: Hidden-State Geometry Reveals and Modulates Their Formation","created":"2026-10-12","cited_by_count":0,"area":null}],"next_cursor":null}