{"total":45,"rows":[{"id":"2504.02732","title":"Why do LLMs attend to the first token?","created":"2025-04-03","cited_by_count":127,"area":null},{"id":"2502.01951","title":"On the Emergence of Position Bias in Transformers","created":"2025-02-04","cited_by_count":59,"area":null},{"id":"2510.06477","title":"Attention Sinks and Compression Valleys in LLMs are Two Sides of the Same Coin","created":"2025-10-07","cited_by_count":52,"area":null},{"id":"2410.06833","title":"Dynamic metastability in the self-attention model","created":"2024-10-09","cited_by_count":46,"area":null},{"id":"2502.17598","title":"Hallucination Detection in LLMs Using Spectral Features of Attention Maps","created":"2025-02-24","cited_by_count":43,"area":null},{"id":"2411.04551","title":"Measure-to-measure interpolation using Transformers","created":"2024-11-07","cited_by_count":29,"area":null},{"id":"2412.02682","title":"The Asymptotic Behavior of Attention in Transformers","created":"2024-12-03","cited_by_count":16,"area":null},{"id":"2507.07814","title":"Pay Attention to Attention Distribution: A New Local Lipschitz Bound for Transformers","created":"2025-07-10","cited_by_count":11,"area":null},{"id":"2510.16670","title":"All You Need is One: Capsule Prompt Tuning with a Single Vector","created":"2025-10-19","cited_by_count":8,"area":null},{"id":"2512.14366","title":"Optimizing Rank for High-Fidelity Implicit Neural Representations","created":"2025-12-16","cited_by_count":8,"area":null},{"id":"2406.17837","title":"Transformer Normalisation Layers and the Independence of Semantic Subspaces","created":"2024-06-25","cited_by_count":6,"area":null},{"id":"2506.03790","title":"Attention-Only Transformers via Unrolled Subspace Denoising","created":"2025-06-04","cited_by_count":5,"area":null},{"id":"2508.21421","title":"Rethinking Layer-wise Model Merging through Chain of Merges","created":"2025-08-29","cited_by_count":5,"area":null},{"id":"2511.09146","title":"DoPE: Denoising Rotary Position Embedding","created":"2025-11-12","cited_by_count":5,"area":null},{"id":"2410.10609","title":"Lambda-Skip Connections: the architectural component that prevents Rank Collapse","created":"2024-10-14","cited_by_count":4,"area":null},{"id":"2602.08626","title":"Revisiting [CLS] and Patch Token Interaction in Vision Transformers","created":"2026-02-09","cited_by_count":4,"area":null},{"id":"2410.09637","title":"ReLU's Revival: On the Entropic Overload in Normalization-Free Large Language Models","created":"2024-10-12","cited_by_count":3,"area":null},{"id":"2410.13060","title":"AERO: Entropy-Guided Framework for Private LLM Inference","created":"2024-10-16","cited_by_count":3,"area":null},{"id":"2603.06922","title":"NerVE: Nonlinear Eigenspectrum Dynamics in LLM Feed-Forward Networks","created":"2026-03-06","cited_by_count":3,"area":null},{"id":"2602.10956","title":"Stochastic Parroting in Temporal Attention -- Regulating the Diagonal Sink","created":"2026-02-11","cited_by_count":2,"area":null},{"id":"2607.07678","title":"How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization","created":"2026-07-08","cited_by_count":2,"area":null},{"id":"2607.14018","title":"Transforming Rank: How Architecture Navigates the Spectral Pathologies of Depth","created":"2026-07-15","cited_by_count":2,"area":null},{"id":"2410.19931","title":"Provable optimal transport with transformers: The essence of depth and prompt engineering","created":"2024-10-25","cited_by_count":1,"area":null},{"id":"2506.09280","title":"TTrace: Lightweight Error Checking and Diagnosis for Distributed Training","created":"2025-06-10","cited_by_count":1,"area":null},{"id":"2512.09182","title":"Understanding the Failure Modes of Transformers through the Lens of Graph Neural Networks","created":"2025-12-09","cited_by_count":1,"area":null},{"id":"2512.20245","title":"Memory as Resonance: A Biomimetic Architecture for Infinite Context Memory on Ergodic Phonetic Manifolds","created":"2025-12-23","cited_by_count":1,"area":null},{"id":"2604.23681","title":"Rank, Head-Channel Non-Identifiability, and Symmetry Breaking: A Precise Analysis of Representational Collapse in Transformers","created":"2026-04-26","cited_by_count":1,"area":null},{"id":"2605.08453","title":"Sink vs. diagonal patterns as mechanisms for attention switch and oversmoothing prevention","created":"2026-05-08","cited_by_count":1,"area":null},{"id":"2509.05188","title":"SSL-SLR: Self-Supervised Representation Learning for Sign Language Recognition","created":"2025-09-05","cited_by_count":0,"area":null},{"id":"2511.00341","title":"Reversal Invariance in Autoregressive Language Models","created":"2025-11-01","cited_by_count":0,"area":null},{"id":"2512.15600","title":"How Smoothing is N-simplicial Attention?","created":"2025-12-17","cited_by_count":0,"area":null},{"id":"2601.14522","title":"On the Runway Cascade of Transformers for Language Modeling","created":"2026-01-20","cited_by_count":0,"area":null},{"id":"2602.16320","title":"RefineFormer3D: Efficient 3D Medical Image Segmentation via Adaptive Multi-Scale Transformer with Cross Attention Fusion","created":"2026-02-18","cited_by_count":0,"area":null},{"id":"2605.21550","title":"PeakFocus: Bridging Peak Localization and Intensity Regression via a Unified Multi-Scale Framework for Electricity Load Forecasting","created":"2026-05-20","cited_by_count":0,"area":null},{"id":"2605.25619","title":"Analogies between Transformer Layers and Power Method","created":"2026-05-25","cited_by_count":0,"area":null},{"id":"2605.30229","title":"Anti Mode-Collapse in Mean-Field Transformer via Auxiliary Variables","created":"2026-05-28","cited_by_count":0,"area":null},{"id":"2606.05134","title":"Activation-Based Active Learning for In-Context Learning: Challenges and Insights","created":"2026-06-03","cited_by_count":0,"area":null},{"id":"2606.08105","title":"A Unifying View of Attention Sinks: From Mechanisms to Architectural Interventions","created":"2026-06-06","cited_by_count":0,"area":null},{"id":"2607.10677","title":"From Self-Attention to Connection Laplacian: A Unified Operator View of Transformers","created":"2026-07-12","cited_by_count":0,"area":null},{"id":"2607.20484","title":"The Devil is in the Spectrum: Mitigating Representation Collapse in LLMs via Topologically Regularized Side-Path","created":"2026-06-02","cited_by_count":0,"area":null},{"id":"2607.24502","title":"Self-Attention Dynamics with Rotary Position Embeddings: Twisted States and Explicit Consensus Rates on the Sphere","created":"2026-07-27","cited_by_count":0,"area":null},{"id":"2608.09417","title":"Why Post-Norm Transformers Collapse: Attention Amplification and Gradient Repair Failure","created":"2026-08-10","cited_by_count":0,"area":null},{"id":"2609.06341","title":"Linear Algebra Foundations of Efficient Attention: A Phase Reversal in Rank Collapse Under SVD Compression","created":"2026-09-06","cited_by_count":0,"area":null},{"id":"2609.34130","title":"Training and Inference Dynamics of PLDR-LLMs: Row-Map Collapse, Renormalization, and Predictive Reduction","created":"2026-09-28","cited_by_count":0,"area":null},{"id":"2610.13518","title":"Asymptotic Analysis of Discrete-Time Self-Attention Dynamics in Transformers","created":"2026-10-09","cited_by_count":0,"area":null}],"next_cursor":null}