Know What You Don't Know: Unanswerable Questions for SQuAD

1. 2022Training language models to follow instructions with human feedbackcited by 15,971
2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
4. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
5. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
6. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
7. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
8. 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,346
9. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
10. 2023PaLM 2 Technical Reportcited by 1,162
11. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
12. 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 916

50 most cited of 1,554 · All 1,554 (JSON)

1. 2026AFCS: Atomic-Fact-Conditioned Synthesis for Factual Knowledge Pretraining14 Oct 2026
2. 2026Jeva: System One Models from First Principles13 Oct 2026
3. 2026Aligning Faithfulness for Theory-Scale Autoformalization13 Oct 2026
4. 2026Dissociating Answerability from Extraction in LLM Question Answering over Radiology Reports13 Oct 2026
5. 2026Preserving Updates in Low-Bit Recurrent State Quantization11 Oct 2026
6. 2026UltraBERT: Beyond the Limit of BERT Pre-Training10 Oct 2026
7. 2026Do Prompt Optimizers Break Requirements They Are Not Scored On? A Preregistered Study9 Oct 2026
8. 2026DivMoE: Fine-Grained MoE Upcycling via Cross-Domain Expert Composition8 Oct 2026
9. 2026SanSi: A Looped Typed Decision Model for System 1.5 Thinking6 Oct 2026
10. 2026Universal Test-Time Training4 Oct 2026
11. 2026Look Before You Leap: Thermodynamic Arbitration of Parametric and Non-Parametric Knowledge in LLM Agents via Self-Regulating Memory Architectures4 Oct 2026
12. 2026SearchJev: A Fast and Calibrated System-1 Model for Search Agents4 Oct 2026

50 newest of 1,554 · All 1,554 (JSON)

1. 2023PaLM 2 Technical Reportcited by 1,162
2. 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
3. 2022SQA3D: Situated Question Answering in 3D Scenescited by 314
4. 2023SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Modelscited by 256
5. 2025Reasoning with Latent Thoughts: On the Power of Looped Transformerscited by 240
6. 2025AbstentionBench: Reasoning LLMs Fail on Unanswerable Questionscited by 145
7. 2024AttnLRP: Attention-Aware Layer-Wise Relevance Propagation for Transformerscited by 120
8. 2024Concise Thoughts: Impact of Output Length on LLM Reasoning and Costcited by 109
9. 2025OverThink: Slowdown Attacks on Reasoning LLMscited by 96
10. 2026Mamba-3: Improved Sequence Modeling using State Space Principlescited by 89
11. 2023How Robust is GPT-3.5 to Predecessors? A Comprehensive Study on Language Understanding Taskscited by 58
12. 2023Query-Dependent Prompt Evaluation and Optimization with Offline Inverse RLcited by 37

12 most cited of 65 · All 65 (JSON)

1. 2026SanSi: A Looped Typed Decision Model for System 1.5 Thinking6 Oct 2026
2. 2026Trajectory Soup: Pushing the Compute-Scaling Frontier of LLM Mid-training via Diverse Trajectories29 Sep 2026
3. 2026Rethinking Expressivity and Efficiency in Test-Time Training21 Aug 2026
4. 2026You Only Pass Once: Answering and Abstaining Together in a Single Forward Pass of a Frozen Language Model14 Aug 2026
5. 2026FlowEdit: Information-Theoretic Control of LLM Reasoning Flows for Ill-posed Problems Involving Conflicts20 Jun 2026
6. 2026Ling and Ring 2.6 Technical Report: Efficient and Instant Agentic Intelligence at Trillion-Parameter Scale13 Jun 2026
7. 2026Evaluating Multi-Hop Reasoning in RAG Systems: A Comparison of LLM-Based Retriever Evaluation Strategies20 Apr 2026
8. 2026Abstain-R1: Calibrated Abstention and Post-Refusal Clarification via Verifiable RL18 Apr 2026
9. 2026SubSearch: Intermediate Rewards for Unsupervised Guided Reasoning in Complex Retrieval8 Apr 2026
10. 2026Measuring Representation Robustness in Large Language Models for Geometry3 Apr 2026
11. 2026Bridging the Know-Act Gap via Task-Level Autoregressive Reasoning23 Mar 2026
12. 2026Efficient Reasoning on the Edge17 Mar 2026

12 newest of 65 · All 65 (JSON)

1. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
2. 2023RA-DIT: Retrieval-Augmented Dual Instruction Tuningcited by 195
3. 2024xRAG: Extreme Context Compression for Retrieval-augmented Generation with One Tokencited by 125
4. 2024ChatQA: Surpassing GPT-4 on Conversational QA and RAGcited by 90
5. 2024NV-Retriever: Improving text embedding models with effective hard-negative miningcited by 84
6. 2023A Multi-Task Embedder For Retrieval Augmented LLMscited by 64
7. 2023InstructRetro: Instruction Tuning post Retrieval-Augmented Pretrainingcited by 53
8. 2025MTRAG: A Multi-Turn Conversational Benchmark for Evaluating Retrieval-Augmented Generation Systemscited by 51
9. 2023Tree of Clarifications: Answering Ambiguous Questions with Retrieval-Augmented Large Language Modelscited by 43
10. 2024Lifelong Knowledge Editing for LLMs with Retrieval-Augmented Continuous Prompt Learningcited by 40
11. 2023Retrieval-augmented Generation to Improve Math Question-Answering: Trade-offs Between Groundedness and Human Preferencecited by 38
12. 2024CLAPNQ: Cohesive Long-form Answers from Passages in Natural Questions for RAG systemscited by 25

12 most cited of 62 · All 62 (JSON)

1. 2026Relevance Is Not Sufficient Evidence: Detecting Evidence Gaps Before Generation in RAG27 Sep 2026
2. 2026Regime Boundary Alignment for Evidence-Gated Question Answering25 Sep 2026
3. 2026Guaranteeing Faithful Evidence Extraction in Speculative Retrieval-Augmented Generation9 Sep 2026
4. 2026GRIP: Grounded Reasoning via Information-Restricted Premises17 Aug 2026
5. 2026SIRIN: A Unified Toolkit for Detecting Contextual Hallucinations in Retrieval-Augmented and Memory-Grounded LLM Systems20 Jul 2026
6. 2026Ricci-Filtration: Boosting Retrieval-Augmented Generation Reranker to Query-Answer Tasks by Discrete Ricci Flow13 Jun 2026
7. 2026RAISE: RAG Design as an Architecture Search Problem28 May 2026
8. 2026BalanceRAG: Joint Risk Calibration for Cascaded Retrieval-Augmented Generation19 May 2026
9. 2026Retrieval-Augmented Linguistic Calibration19 May 2026
10. 2026EverydayGPT: Confidence-Gated Routing for Efficient and Safe Hybrid GPT-RAG Conversational QA24 Apr 2026
11. 2026Retrieval-Augmented Generation Must Move Beyond Factual Grounding to Represent Diverse Opinions13 Apr 2026
12. 2026Detecting Overflow in Compressed Token Representations for Retrieval-Augmented Generation12 Feb 2026

12 newest of 62 · All 62 (JSON)

1. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
2. 2025Evaluation and Benchmarking of LLM Agents: A Surveycited by 152
3. 2024Language agents achieve superhuman synthesis of scientific knowledgecited by 137
4. 2025Voting or Consensus? Decision-Making in Multi-Agent Debatecited by 59
5. 2024BAGEL: Bootstrapping Agents by Guiding Exploration with Languagecited by 34
6. 2025Position: Uncertainty Quantification Needs Reassessment for Large-language Model Agentscited by 32
7. 2024CMAT: A Multi-Agent Collaboration Tuning Framework for Enhancing Small Language Modelscited by 26
8. 2024Multi-Agent Large Language Models for Conversational Task-Solvingcited by 24
9. 2026Locomo-Plus: Beyond-Factual Cognitive Memory Evaluation Framework for LLM Agentscited by 19
10. 2026Agentic Abstention: Do Agents Know When to Stop Instead of Act?cited by 15
11. 2024SAUP: Situation Awareness Uncertainty Propagation on LLM Agentcited by 14
12. 2024Agent Skill Acquisition for Large Language Models via CycleQDcited by 12

12 most cited of 30 · All 30 (JSON)

1. 2026Look Before You Leap: Thermodynamic Arbitration of Parametric and Non-Parametric Knowledge in LLM Agents via Self-Regulating Memory Architectures4 Oct 2026
2. 2026SearchJev: A Fast and Calibrated System-1 Model for Search Agents4 Oct 2026
3. 2026TelemetrySuffBench: Is Agent Telemetry Sufficient for Failure-Origin Diagnosis?8 Aug 2026
4. 2026EcoAgent-Bench: Evaluating Economic Decision-Making in Budget-Constrained LLM Agents6 Aug 2026
5. 2026Deep Research Pretraining via Predictive Navigation1 Aug 2026
6. 2026Agentic Data Environments8 Jul 2026
7. 2026Agentic Abstention: Do Agents Know When to Stop Instead of Act?27 Jun 2026
8. 2026Enhancing Operational Safety via Agentic Dialogue Hazard Identification Analysis2 Jun 2026
9. 2026WARD: Adversarially Robust Defense of Web Agents Against Prompt Injections14 May 2026
10. 2026Partial Evidence Bench: Benchmarking Authorization-Limited Evidence in Agentic Systems6 May 2026
11. 2026IntrAgent: An LLM Agent for Content-Grounded Information Retrieval through Literature Review23 Apr 2026
12. 2026Beyond RAG for Cyber Threat Intelligence: A Systematic Evaluation of Graph-Based and Agentic Retrieval13 Apr 2026

12 newest of 30 · All 30 (JSON)

1. 2021Learned Token Pruning for Transformerscited by 139
2. 2022Token Dropping for Efficient BERT Pretrainingcited by 42
3. 2021TR-BERT: Dynamic Token Reduction for Accelerating BERT Inferencecited by 40
4. 2024Generation Meets Verification: Accelerating Large Language Model Inference with Smart Parallel Auto-Correct Decodingcited by 22
5. 2025KV Cache Transform Coding for Compact Storage in LLM Inferencecited by 13
6. 2024XC-Cache: Cross-Attending to Cached Context for Efficient LLM Inferencecited by 12
7. 2023Revisiting Token Dropping Strategy in Efficient BERT Pretrainingcited by 11
8. 2024Tandem Transformers for Inference Efficient LLMscited by 10
9. 2024HiRE: High Recall Approximate Top-k Estimation for Efficient LLM Inferencecited by 7
10. 2025Beyond Hard and Soft: Hybrid Context Compression for Balancing Local and Global Information Retentioncited by 7
11. 2023Constraint-aware and Ranking-distilled Token Pruning for Efficient Transformer Inferencecited by 6
12. 2026Predicting Future Utility: Global Combinatorial Optimization for Task-Agnostic KV Cache Evictioncited by 6

12 most cited of 20 · All 20 (JSON)

1. 2026Intra-Prompt Parallel Decoding for Common-Context Question Answering4 Sep 2026
2. 2026HijackKV: New Threat in Position-Independent KV Cache Reuse22 Jul 2026
3. 2026VIA-SD: Verification via Intra-Model Routing for Speculative Decoding10 Jun 2026
4. 2026Stochastic Sparse Attention for Memory-Bound Inference3 May 2026
5. 2026Predicting Future Utility: Global Combinatorial Optimization for Task-Agnostic KV Cache Eviction9 Feb 2026
6. 2025KV Cache Transform Coding for Compact Storage in LLM Inference3 Nov 2025
7. 2025Controlling the Risk of Corrupted Contexts for Language Models via Early-Exiting2 Oct 2025
8. 2025Beyond Greedy Exits: Improved Early Exit Decisions for Risk Control and Reliability28 Sep 2025
9. 2025QwenLong-CPRS: Towards ∞-LLMs with Dynamic Context Optimization23 May 2025
10. 2025Beyond Hard and Soft: Hybrid Context Compression for Balancing Local and Global Information Retention21 May 2025
11. 2024Dynamic-Width Speculative Beam Decoding for Efficient LLM Inference25 Sep 2024
12. 2024XC-Cache: Cross-Attending to Cached Context for Efficient LLM Inference23 Apr 2024

12 newest of 20 · All 20 (JSON)

1. 2023PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Promptscited by 226
2. 2021Hidden Backdoors in Human-Centric Language Modelscited by 90
3. 2024Neural Exec: Learning (and Learning from) Execution Triggers for Prompt Injection Attackscited by 85
4. 2023NOTABLE: Transferable Backdoor Attacks Against Prompt-based NLP Modelscited by 37
5. 2022Kallima: A Clean-label Framework for Textual Backdoor Attackscited by 24
6. 2024Goal-guided Generative Prompt Injection Attack on Large Language Modelscited by 24
7. 2025MorphMark: Flexible Adaptive Watermarking for Large Language Modelscited by 24
8. 2024Towards Robust Evaluation of Unlearning in LLMs via Data Transformationscited by 20
9. 2023BDMMT: Backdoor Sample Detection for Language Models through Model Mutation Testingcited by 16
10. 2026PISmith: Reinforcement Learning-based Red Teaming for Prompt Injection Defensescited by 16
11. 2026PIArena: A Platform for Prompt Injection Evaluationcited by 11
12. 2023Robustness Over Time: Understanding Adversarial Examples' Effectiveness on Longitudinal Versions of Large Language Modelscited by 7

12 most cited of 20 · All 20 (JSON)

1. 2026Membership Inference Attacks for Retrieval Based In-Context Learning for Document Question Answering5 May 2026
2. 2026PIArena: A Platform for Prompt Injection Evaluation9 Apr 2026
3. 2026PISmith: Reinforcement Learning-based Red Teaming for Prompt Injection Defenses13 Mar 2026
4. 2026ArcMark: Distortion-Free Multi-Byte LLM Watermark via Optimal Transport6 Feb 2026
5. 2025Detecting Prompt Injection Attacks Against Application Using Classifiers14 Dec 2025
6. 2025Universal Adversarial Suffixes for Language Models Using Reinforcement Learning with Calibrated Reward9 Dec 2025
7. 2025Detecting Stealthy Backdoor Samples based on Intra-class Distance for Large Language Models29 May 2025
8. 2025DyePack: Provably Flagging Test Set Contamination in LLMs Using Backdoors29 May 2025
9. 2025MorphMark: Flexible Adaptive Watermarking for Large Language Models14 May 2025
10. 2024Towards Robust Evaluation of Unlearning in LLMs via Data Transformations23 Nov 2024
11. 2024Mitigating Social Biases in Language Models through Unlearning19 Jun 2024
12. 2024TrojFM: Resource-efficient Backdoor Attacks against Very Large Foundation Models27 May 2024

12 newest of 20 · All 20 (JSON)

1. 2024Survey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Applicationcited by 56
2. 2023HomoDistil: Homotopic Task-Agnostic Distillation of Pre-trained Transformerscited by 25
3. 2021VidLanKD: Improving Language Understanding via Video-Distilled Knowledge Transfercited by 22
4. 2021RAIL-KD: RAndom Intermediate Layer Mapping for Knowledge Distillationcited by 19
5. 2023A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Trainingcited by 16
6. 2021EfficientBERT: Progressively Searching Multilayer Perceptron via Warm-up Knowledge Distillationcited by 15
7. 2022Improving Generalization of Pre-trained Language Models via Stochastic Weight Averagingcited by 9
8. 2024Towards Competitive Search Relevance For Inference-Free Learned Sparse Retrieverscited by 8
9. 2023ERNIE 3.0 Tiny: Frustratingly Simple Method to Improve Task-Agnostic Distillation Generalizationcited by 3
10. 2023Efficient Transformer Knowledge Distillation: A Performance Reviewcited by 2
11. 2021Knowledge Distillation with Noisy Labels for Natural Language Understandingcited by 1
12. 2024MLKD-BERT: Multi-level Knowledge Distillation for Pre-trained Language Modelscited by 1

12 most cited of 16 · All 16 (JSON)

1. 2026Do Student LLMs Inherit OOD Robustness? Invariance-Weighted Distillation for Reliable Knowledge Transfer18 Sep 2026
2. 2026Multi-Aspect Knowledge Distillation for Language Model with Low-rank Factorization3 Apr 2026
3. 2026Decoder-based Sense Knowledge Distillation25 Feb 2026
4. 2025Exploring the Limits of Model Compression in LLMs: A Knowledge Distillation Study on QA Tasks10 Jul 2025
5. 2024Towards Competitive Search Relevance For Inference-Free Learned Sparse Retrievers7 Nov 2024
6. 2024MLKD-BERT: Multi-level Knowledge Distillation for Pre-trained Language Models3 Jul 2024
7. 2024Survey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Application2 Jul 2024
8. 2023Efficient Transformer Knowledge Distillation: A Performance Review22 Nov 2023
9. 2023A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Training3 May 2023
10. 2023HomoDistil: Homotopic Task-Agnostic Distillation of Pre-trained Transformers19 Feb 2023
11. 2023ERNIE 3.0 Tiny: Frustratingly Simple Method to Improve Task-Agnostic Distillation Generalization9 Jan 2023
12. 2022Improving Generalization of Pre-trained Language Models via Stochastic Weight Averaging12 Dec 2022

12 newest of 16 · All 16 (JSON)

1. 2024MuirBench: A Comprehensive Benchmark for Robust Multi-image Understandingcited by 188
2. 2023What You See is What You Read? Improving Text-Image Alignment Evaluationcited by 108
3. 2023VisIT-Bench: A Benchmark for Vision-Language Instruction Following Inspired by Real-World Usecited by 102
4. 2025Scaling Text-Rich Image Understanding via Code-Guided Synthetic Multimodal Data Generationcited by 58
5. 2024MMDocBench: Benchmarking Large Vision-Language Models for Fine-Grained Visual Document Understandingcited by 19
6. 2024TLDR: Token-Level Detective Reward Model for Large Vision Language Modelscited by 15
7. 2024Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Modelscited by 13
8. 2025Skip-Vision: Efficient and Scalable Acceleration of Vision-Language Models via Adaptive Token Skippingcited by 12
9. 2025Evaluating Multimodal Language Models as Visual Assistants for Visually Impaired Userscited by 11
10. 2025Towards Understanding Visual Grounding in Visual Language Modelscited by 10
11. 2026TRAPSBench: Vision-Language Models Encode but Fail to Express Epistemic Restraintcited by 5
12. 2025Explicit Abstention Knobs for Predictable Reliability in Video Question Answeringcited by 3

12 most cited of 16 · All 16 (JSON)

1. 2026Knowing What Not to Answer: Selective Non-Compliance in Vision-Language Models4 Sep 2026
2. 2026FPCO-Dialog: A Multi-Turn False-Premise Benchmark for Correction and Cooperation in Vision-Language Models3 Sep 2026
3. 2026TRAPSBench: Vision-Language Models Encode but Fail to Express Epistemic Restraint13 Aug 2026
4. 2025Explicit Abstention Knobs for Predictable Reliability in Video Question Answering31 Dec 2025
5. 2025Instruction-Following Evaluation of Large Vision-Language Models29 Dec 2025
6. 2025Towards Understanding Visual Grounding in Visual Language Models12 Sep 2025
7. 2025Evaluating Multimodal Language Models as Visual Assistants for Visually Impaired Users28 Mar 2025
8. 2025Skip-Vision: Efficient and Scalable Acceleration of Vision-Language Models via Adaptive Token Skipping26 Mar 2025
9. 2025Scaling Text-Rich Image Understanding via Code-Guided Synthetic Multimodal Data Generation20 Feb 2025
10. 2024MMDocBench: Benchmarking Large Vision-Language Models for Fine-Grained Visual Document Understanding25 Oct 2024
11. 2024TLDR: Token-Level Detective Reward Model for Large Vision Language Models7 Oct 2024
12. 2024Gamified crowd-sourcing of high-quality data for visual fine-tuning5 Oct 2024

12 newest of 16 · All 16 (JSON)

1. 2022Task-Specific Expert Pruning for Sparse Mixture-of-Expertscited by 72
2. 2021Go Wider Instead of Deepercited by 57
3. 2025Parameters vs FLOPs: Scaling Laws for Optimal Sparsity for Mixture-of-Experts Language Modelscited by 50
4. 2022MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptationcited by 37
5. 2022One Student Knows All Experts Know: From Sparse to Densecited by 25
6. 2025Drop-Upcycling: Training Sparse Mixture of Experts with Partial Re-initializationcited by 24
7. 2025BadMoE: Backdooring Mixture-of-Experts LLMs via Optimizing Routing Triggers and Infecting Dormant Expertscited by 14
8. 2021Simple or Complex? Complexity-Controllable Question Generation with Soft Templates and Deep Mixture of Experts Modelcited by 8
9. 2025MoLEx: Mixture of Layer Experts for Finetuning with Sparse Upcyclingcited by 5
10. 2025DuoServe-MoE: Dual-Phase Expert Prefetch and Caching for LLM Inference QoS Assurancecited by 5
11. 2023COMET: Learning Cardinality Constrained Mixture of Experts with Trees and Local Searchcited by 2
12. 2025MossNet: Mixture of State-Space Experts is a Multi-Head Attentioncited by 0

12 most cited of 15 · All 15 (JSON)

1. 2026DivMoE: Fine-Grained MoE Upcycling via Cross-Domain Expert Composition8 Oct 2026
2. 2026Universal Test-Time Training4 Oct 2026
3. 2026Groundhog Bit-Flip Attack: Seeding Infinite Generation Loops in Mixture-of-Experts LLMs through Bit Flips26 Aug 2026
4. 2025MossNet: Mixture of State-Space Experts is a Multi-Head Attention30 Oct 2025
5. 2025DuoServe-MoE: Dual-Phase Expert Prefetch and Caching for LLM Inference QoS Assurance9 Sep 2025
6. 2025BadMoE: Backdooring Mixture-of-Experts LLMs via Optimizing Routing Triggers and Infecting Dormant Experts24 Apr 2025
7. 2025MoLEx: Mixture of Layer Experts for Finetuning with Sparse Upcycling14 Mar 2025
8. 2025Drop-Upcycling: Training Sparse Mixture of Experts with Partial Re-initialization26 Feb 2025
9. 2025Parameters vs FLOPs: Scaling Laws for Optimal Sparsity for Mixture-of-Experts Language Models21 Jan 2025
10. 2023COMET: Learning Cardinality Constrained Mixture of Experts with Trees and Local Search5 Jun 2023
11. 2022Task-Specific Expert Pruning for Sparse Mixture-of-Experts1 Jun 2022
12. 2022MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation15 Apr 2022

12 newest of 15 · All 15 (JSON)

1. 2023Gated Linear Attention Transformers with Hardware-Efficient Trainingcited by 514
2. 2024An Empirical Study of Mamba-based Language Modelscited by 186
3. 2024Unlocking State-Tracking in Linear RNNs Through Negative Eigenvaluescited by 101
4. 2024Longhorn: State Space Models are Amortized Online Learnerscited by 59
5. 2024Jamba-1.5: Hybrid Transformer-Mamba Models at Scalecited by 50
6. 2024DeciMamba: Exploring the Length Extrapolation Potential of Mambacited by 49
7. 2026Gated DeltaNet-2: Decoupling Erase and Write in Linear Attentioncited by 33
8. 2025Quamba2: A Robust and Scalable Post-training Quantization Framework for Selective State Space Modelscited by 16
9. 2025Overflow Prevention Enhances Long-Context Recurrent LLMscited by 6
10. 2025Understanding and Enhancing Mamba-Transformer Hybrids for Memory Recall and Language Modelingcited by 5
11. 2024Taipan: Efficient and Expressive State Space Language Models with Selective Attentioncited by 4
12. 2024Revealing and Mitigating the Local Pattern Shortcuts of Mambacited by 3

12 most cited of 13 · All 13 (JSON)

1. 2026DART: Decoded Attention over Recurrent States for Efficient Long-Context Sequence Modeling3 Aug 2026
2. 2026Gated DeltaNet-2: Decoupling Erase and Write in Linear Attention21 May 2026
3. 2025Understanding and Enhancing Mamba-Transformer Hybrids for Memory Recall and Language Modeling30 Oct 2025
4. 2025Overflow Prevention Enhances Long-Context Recurrent LLMs12 May 2025
5. 2025Quamba2: A Robust and Scalable Post-training Quantization Framework for Selective State Space Models28 Mar 2025
6. 2024Unlocking State-Tracking in Linear RNNs Through Negative Eigenvalues19 Nov 2024
7. 2024Taipan: Efficient and Expressive State Space Language Models with Selective Attention24 Oct 2024
8. 2024Revealing and Mitigating the Local Pattern Shortcuts of Mamba21 Oct 2024
9. 2024Jamba-1.5: Hybrid Transformer-Mamba Models at Scale22 Aug 2024
10. 2024Longhorn: State Space Models are Amortized Online Learners19 Jul 2024
11. 2024DeciMamba: Exploring the Length Extrapolation Potential of Mamba20 Jun 2024
12. 2024An Empirical Study of Mamba-based Language Models12 Jun 2024

12 newest of 13 · All 13 (JSON)

1. 2022Training language models to follow instructions with human feedbackcited by 15,971
2. 2023Mitigating the Alignment Tax of RLHFcited by 183
3. 2023DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scalescited by 108
4. 2024Don't Just Say "I don't know"! Self-aligning Large Language Models for Responding to Unknown Questions with Explanationscited by 30
5. 2024SAIL: Self-Improving Efficient Online Alignment of Large Language Modelscited by 20
6. 2025Massive Supervised Fine-tuning Experiments Reveal How Data, Layer, and Training Factors Shape LLM Alignment Qualitycited by 14
7. 2024Would I Lie To You? Inference Time Alignment of Language Models using Direct Preference Headscited by 5
8. 2025Curvature-Aware Safety Restoration In LLMs Fine-Tuningcited by 5
9. 2026Continual Safety Alignment via Gradient-Based Sample Selectioncited by 4
10. 2025A Systematic Analysis of Base Model Choice for Reward Modelingcited by 0
11. 2026Generalizable Lifelong Model Editing via Preference Optimizationcited by 0

1. 2026Generalizable Lifelong Model Editing via Preference Optimization29 Sep 2026
2. 2026Continual Safety Alignment via Gradient-Based Sample Selection19 Apr 2026
3. 2025Curvature-Aware Safety Restoration In LLMs Fine-Tuning22 Nov 2025
4. 2025Massive Supervised Fine-tuning Experiments Reveal How Data, Layer, and Training Factors Shape LLM Alignment Quality17 Jun 2025
5. 2025A Systematic Analysis of Base Model Choice for Reward Modeling16 May 2025
6. 2024SAIL: Self-Improving Efficient Online Alignment of Large Language Models21 Jun 2024
7. 2024Would I Lie To You? Inference Time Alignment of Language Models using Direct Preference Heads30 May 2024
8. 2024Don't Just Say "I don't know"! Self-aligning Large Language Models for Responding to Unknown Questions with Explanations23 Feb 2024
9. 2023Mitigating the Alignment Tax of RLHF12 Sep 2023
10. 2023DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales2 Aug 2023
11. 2022Training language models to follow instructions with human feedback4 Mar 2022

1. 2025Do Sparse Autoencoders Generalize? A Case Study of Answerabilitycited by 8
2. 2024Wasserstein Distances, Neuronal Entanglement, and Sparsitycited by 6
3. 2025RECALL: REpresentation-aligned Catastrophic-forgetting ALLeviation via Hierarchical Model Mergingcited by 5
4. 2025Fine-Tuning is Subgraph Search: A New Lens on Learning Dynamicscited by 3
5. 2025The Logical Implication Steering Method for Conditional Interventions on Transformer Generationcited by 1
6. 2026Can LLMs Judge Better Than They Generate? Evaluating Task Asymmetry, Mechanistic Interpretability and Transferability for In-Context QAcited by 1
7. 2026The Commit-Abstain Circuit: Why Language Models Hallucinate Instead of Abstainingcited by 0

1. 2026The Commit-Abstain Circuit: Why Language Models Hallucinate Instead of Abstaining26 Sep 2026
2. 2026Can LLMs Judge Better Than They Generate? Evaluating Task Asymmetry, Mechanistic Interpretability and Transferability for In-Context QA26 Jun 2026
3. 2025RECALL: REpresentation-aligned Catastrophic-forgetting ALLeviation via Hierarchical Model Merging23 Oct 2025
4. 2025Do Sparse Autoencoders Generalize? A Case Study of Answerability27 Feb 2025
5. 2025Fine-Tuning is Subgraph Search: A New Lens on Learning Dynamics10 Feb 2025
6. 2025The Logical Implication Steering Method for Conditional Interventions on Transformer Generation5 Feb 2025
7. 2024Wasserstein Distances, Neuronal Entanglement, and Sparsity24 May 2024

1. 2024FM2DS: Few-Shot Multimodal Multihop Data Synthesis with Knowledge Distillation for Question Answeringcited by 7
2. 2025AQuilt: Weaving Logic and Self-Inspection into Low-Cost, High-Relevance Data Synthesis for Specialist LLMscited by 4
3. 2025Grounding Synthetic Data Evaluations of Language Models in Unsupervised Document Corporacited by 2
4. 2026Not All Explanations Simulate Equally: Comparing Verbalized Feature Attributions and Self-Generated Rationalescited by 1
5. 2026Quantifying Error Tolerance in Synthetic Data: An Atomic-level Operand vs. Operator Perturbation Studycited by 0

1. 2026Quantifying Error Tolerance in Synthetic Data: An Atomic-level Operand vs. Operator Perturbation Study29 Aug 2026
2. 2026Not All Explanations Simulate Equally: Comparing Verbalized Feature Attributions and Self-Generated Rationales31 May 2026
3. 2025AQuilt: Weaving Logic and Self-Inspection into Low-Cost, High-Relevance Data Synthesis for Specialist LLMs24 Jul 2025
4. 2025Grounding Synthetic Data Evaluations of Language Models in Unsupervised Document Corpora13 May 2025
5. 2024FM2DS: Few-Shot Multimodal Multihop Data Synthesis with Knowledge Distillation for Question Answering9 Dec 2024

1. 2025LLaDA2.0: Scaling Up Diffusion Language Models to 100Bcited by 166
2. 2026LLaDA2.1: Speeding Up Text Diffusion via Token Editingcited by 54
3. 2025Cosmos: Compressed and Smooth Latent Space for Text Diffusion Modelingcited by 25

1. 2026LLaDA2.1: Speeding Up Text Diffusion via Token Editing9 Feb 2026
2. 2025LLaDA2.0: Scaling Up Diffusion Language Models to 100B10 Dec 2025
3. 2025Cosmos: Compressed and Smooth Latent Space for Text Diffusion Modeling26 Jun 2025

1. 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 725
2. 2022Offline RL for Natural Language Generation with Implicit Language Q Learningcited by 138
3. 2024QPO: Query-dependent Prompt Optimization via Multi-Loop Offline Reinforcement Learningcited by 10

1. 2024QPO: Query-dependent Prompt Optimization via Multi-Loop Offline Reinforcement Learning20 Aug 2024
2. 2022Offline RL for Natural Language Generation with Implicit Language Q Learning5 Jun 2022
3. 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulation6 Aug 2021

1. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 897
2. 2021Learning Knowledge Graph-based World Models of Textual Environmentscited by 31
3. 2021Modeling Worlds in Textcited by 11

1. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Experts13 Dec 2021
2. 2021Learning Knowledge Graph-based World Models of Textual Environments17 Jun 2021
3. 2021Modeling Worlds in Text17 Jun 2021

1. 2025Sequential Policy Gradient for Adaptive Hyperparameter Optimizationcited by 1

1. 2025Sequential Policy Gradient for Adaptive Hyperparameter Optimization18 Jun 2025

1. 2025Do What? Teaching Vision-Language-Action Models to Reject the Impossiblecited by 7

1. 2025Do What? Teaching Vision-Language-Action Models to Reject the Impossible22 Aug 2025

1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
3. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
4. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
5. 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,346
6. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
7. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
8. 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 916
9. 2023The Flan Collection: Designing Data and Methods for Effective Instruction Tuningcited by 739
10. 2022A Survey on In-context Learningcited by 721
11. 2022A-OKVQA: A Benchmark for Visual Question Answering using World Knowledgecited by 710
12. 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 708

12 most cited of 1,263 · All 1,263 (JSON)

1. 2026AFCS: Atomic-Fact-Conditioned Synthesis for Factual Knowledge Pretraining14 Oct 2026
2. 2026Jeva: System One Models from First Principles13 Oct 2026
3. 2026Aligning Faithfulness for Theory-Scale Autoformalization13 Oct 2026
4. 2026Dissociating Answerability from Extraction in LLM Question Answering over Radiology Reports13 Oct 2026
5. 2026Preserving Updates in Low-Bit Recurrent State Quantization11 Oct 2026
6. 2026UltraBERT: Beyond the Limit of BERT Pre-Training10 Oct 2026
7. 2026Do Prompt Optimizers Break Requirements They Are Not Scored On? A Preregistered Study9 Oct 2026
8. 2026More Value per Key: Asymmetric Sparse Attention for Faster LLM Decoding3 Oct 2026
9. 2026Not Until the Evidence Says So: Teaching LLM Investigators When to Close a Case2 Oct 2026
10. 2026Which LLM to pick? Online Active Model Selection for Large Language Models1 Oct 2026
11. 2026ARCCS: An Automated Regulatory Compliance Checking System1 Oct 2026
12. 2026Switching Linear Attention30 Sep 2026

12 newest of 1,263 · All 1,263 (JSON)