{"list":"other","total":65,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"2505.09388","title":"Qwen3 Technical Report","created":"2025-05-14","cited_by_count":8820},{"id":"2312.00752","title":"Mamba: Linear-Time Sequence Modeling with Selective State Spaces","created":"2023-12-01","cited_by_count":4718},{"id":"2104.09864","title":"RoFormer: Enhanced Transformer with Rotary Position Embedding","created":"2021-04-20","cited_by_count":4703},{"id":"1409.0473","title":"Neural Machine Translation by Jointly Learning to Align and Translate","created":"2014-09-01","cited_by_count":4548},{"id":"2205.14135","title":"FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness","created":"2022-05-27","cited_by_count":3673},{"id":"2004.05150","title":"Longformer: The Long-Document Transformer","created":"2020-04-10","cited_by_count":3413},{"id":"2006.16236","title":"Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention","created":"2020-06-29","cited_by_count":2022},{"id":"1905.00414","title":"Similarity of Neural Network Representations Revisited","created":"2019-05-01","cited_by_count":1755},{"id":"2006.04768","title":"Linformer: Self-Attention with Linear Complexity","created":"2020-06-08","cited_by_count":1474},{"id":"2305.13245","title":"GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints","created":"2023-05-22","cited_by_count":1346},{"id":"2405.21060","title":"Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality","created":"2024-05-31","cited_by_count":1336},{"id":"2207.04672","title":"No Language Left Behind: Scaling Human-Centered Machine Translation","created":"2022-07-11","cited_by_count":1312},{"id":"1905.09418","title":"Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned","created":"2019-05-23","cited_by_count":856},{"id":"2309.00071","title":"YaRN: Efficient Context Window Extension of Large Language Models","created":"2023-08-31","cited_by_count":601},{"id":"2412.06464","title":"Gated Delta Networks: Improving Mamba2 with Delta Rule","created":"2024-12-09","cited_by_count":532},{"id":"2210.03057","title":"Language Models are Multilingual Chain-of-Thought Reasoners","created":"2022-10-06","cited_by_count":530},{"id":"2212.14052","title":"Hungry Hungry Hippos: Towards Language Modeling with State Space Models","created":"2022-12-28","cited_by_count":499},{"id":"2406.06484","title":"Parallelizing Linear Transformers with the Delta Rule over Sequence Length","created":"2024-06-10","cited_by_count":396},{"id":"2305.19466","title":"The Impact of Positional Encoding on Length Generalization in Transformers","created":"2023-05-31","cited_by_count":327},{"id":"2308.16884","title":"The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants","created":"2023-08-31","cited_by_count":311},{"id":"2505.06708","title":"Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free","created":"2025-05-10","cited_by_count":283},{"id":"2206.13947","title":"Long Range Language Modeling via Gated State Spaces","created":"2022-06-27","cited_by_count":265},{"id":"2406.07887","title":"An Empirical Study of Mamba-based Language Models","created":"2024-06-12","cited_by_count":186},{"id":"2501.16496","title":"Open Problems in Mechanistic Interpretability","created":"2025-01-27","cited_by_count":179},{"id":"2406.07522","title":"Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling","created":"2024-06-11","cited_by_count":174},{"id":"2402.18815","title":"How do Large Language Models Handle Multilingualism?","created":"2024-02-29","cited_by_count":150},{"id":"2406.19384","title":"The Remarkable Robustness of LLMs: Stages of Inference?","created":"2024-06-27","cited_by_count":146},{"id":"2506.20920","title":"FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language","created":"2025-06-26","cited_by_count":143},{"id":"2408.15237","title":"The Mamba in the Llama: Distilling and Accelerating Hybrid Models","created":"2024-08-27","cited_by_count":122},{"id":"2002.03518","title":"Multilingual Alignment of Contextual Word Representations","created":"2020-02-10","cited_by_count":114},{"id":"2411.12537","title":"Unlocking State-Tracking in Linear RNNs Through Negative Eigenvalues","created":"2024-11-19","cited_by_count":101},{"id":"2404.02431","title":"On the Multilingual Ability of Decoder-based Pre-trained Language Models: Finding and Controlling Language-Specific Neurons","created":"2024-04-03","cited_by_count":83},{"id":"2503.10497","title":"MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation","created":"2025-03-13","cited_by_count":79},{"id":"2411.04986","title":"The Semantic Hub Hypothesis: Language Models Share Semantic Representations Across Languages and Modalities","created":"2024-11-07","cited_by_count":69},{"id":"2401.04658","title":"Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models","created":"2024-01-09","cited_by_count":57},{"id":"2507.22448","title":"Falcon-H1: A Family of Hybrid-Head Language Models Redefining Efficiency and Performance","created":"2025-07-30","cited_by_count":57},{"id":"2510.18855","title":"Every Step Evolves: Scaling Reinforcement Learning for Trillion-Scale Thinking Model","created":"2025-10-21","cited_by_count":55},{"id":"2501.18795","title":"Rope to Nope and Back Again: A New Hybrid Attention Strategy","created":"2025-01-30","cited_by_count":47},{"id":"2205.03286","title":"GlobEnc: Quantifying Global Token Attribution by Incorporating the Whole Encoder Layer in Transformers","created":"2022-05-06","cited_by_count":44},{"id":"2411.08745","title":"Separating Tongue from Thought: Activation Patching Reveals Language-Agnostic Concept Representations in Transformers","created":"2024-11-13","cited_by_count":44},{"id":"2110.14782","title":"When is BERT Multilingual? Isolating Crucial Ingredients for Cross-lingual Transfer","created":"2021-10-27","cited_by_count":42},{"id":"2508.15884","title":"Jet-Nemotron: Efficient Language Model with Post Neural Architecture Search","created":"2025-08-21","cited_by_count":41},{"id":"2506.04761","title":"Log-Linear Attention","created":"2025-06-05","cited_by_count":40},{"id":"2507.06457","title":"A Systematic Analysis of Hybrid Linear Attention","created":"2025-07-08","cited_by_count":39},{"id":"2306.02873","title":"DecompX: Explaining Transformers Decisions by Propagating Token Decomposition","created":"2023-06-05","cited_by_count":31},{"id":"2510.04694","title":"Multilingual Routing in Mixture-of-Experts","created":"2025-10-06","cited_by_count":29},{"id":"2410.09223","title":"The Same But Different: Structural Similarities and Differences in Multilingual Language Modeling","created":"2024-10-11","cited_by_count":28},{"id":"2604.03444","title":"Olmo Hybrid: From Theory to Practice and Back","created":"2026-04-03","cited_by_count":22},{"id":"2410.01335","title":"Layer Swapping for Zero-Shot Cross-Lingual Transfer in Large Language Models","created":"2024-10-02","cited_by_count":21},{"id":"2512.20569","title":"Distilling to Hybrid Attention Models via KL-Guided Layer Selection","created":"2025-12-23","cited_by_count":20},{"id":"2503.01996","title":"One ruler to measure them all: Benchmarking multilingual long-context language models","created":"2025-03-03","cited_by_count":19},{"id":"2306.02790","title":"Exploring the Relationship between Alignment and Cross-lingual Transfer in Multilingual Transformers","created":"2023-06-05","cited_by_count":18},{"id":"2505.17272","title":"Zebra-Llama: Towards Extremely Efficient Hybrid Models","created":"2025-05-22","cited_by_count":18},{"id":"2601.22156","title":"Hybrid Linear Attention Done Right: Efficient Distillation and Effective Architectures for Extremely Long Contexts","created":"2026-01-29","cited_by_count":18},{"id":"2108.08375","title":"Contributions of Transformer Attention Heads in Multi- and Cross-lingual Tasks","created":"2021-08-18","cited_by_count":16},{"id":"2510.07019","title":"Native Hybrid Attention for Efficient Sequence Modeling","created":"2025-10-08","cited_by_count":10},{"id":"2411.17666","title":"How do Multimodal Foundation Models Encode Text and Speech? An Analysis of Cross-Lingual and Cross-Modal Representations","created":"2024-11-26","cited_by_count":9},{"id":"2505.18356","title":"The Unreasonable Effectiveness of Model Merging for Cross-Lingual Transfer in LLMs","created":"2025-05-23","cited_by_count":9},{"id":"2603.17102","title":"Knowledge Localization in Mixture-of-Experts LLMs Using Cross-Lingual Inconsistency","created":"2026-03-17","cited_by_count":6},{"id":"2606.15378","title":"Rethinking the Role of Efficient Attention in Hybrid Architectures","created":"2026-06-13","cited_by_count":5},{"id":"2601.11667","title":"Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction","created":"2026-01-16","cited_by_count":3},{"id":"2511.07498","title":"Focusing on Language: Revealing and Exploiting Language Attention Heads in Multilingual Large Language Models","created":"2025-11-10","cited_by_count":2},{"id":"2608.08775","title":"OmnilingualGAIA2: Evaluating the Multilingual Gap in Frontier AI Agents","created":"2026-08-09","cited_by_count":2},{"id":"2609.04434","title":"What Attention Recalls and Recurrence Controls in Hybrid Language Models","created":"2026-09-03","cited_by_count":2}],"next_cursor":null}