TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension
Not on the map. Why?
Cited by 454 in Retrieval-augmented generation, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We present TriviaQA, a challenging reading comprehension dataset containing over 650K question-answer-evidence triples. TriviaQA includes 95K question-answer pairs authored by trivia enthusiasts and independently gathered evidence documents, six per question on average, that provide high quality distant supervision for answering the questions. We show that, in comparison to other recently introduced large-scale datasets, TriviaQA (1) has relatively complex, compositional questions, (2) has considerable syntactic and lexical variability between questions and corresponding answer-evidence sentences, and (3) requires more cross sentence reasoning to find answers. We also present two baseline algorithms: a feature-based classifier and a state-of-the-art neural network, that performs well on SQuAD reading comprehension. Neither approach comes close to human performance (23% and 40% vs. 80%), suggesting that TriviaQA is a challenging testbed that is worth significant future study. Data and code available at -- http://nlp.cs.washington.edu/triviaqa/
Key facts. Cited by 2,955 papers in the map (data through 14 Oct 2026). First posted on arXiv 9 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 159; 2022: 195; 2023: 276; 2024: 646; 2025: 849; 2026: 829.
2,955 papers.
Sort:
By area:
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
- 2023Mistral 7Bcited by 3,164
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
38 more
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2023A Survey of Large Language Modelscited by 2,576
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
- 2022Language Models (Mostly) Know What They Knowcited by 1,856
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2025Gemma 3 Technical Reportcited by 1,824
- 2024Mixtral of Expertscited by 1,823
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,417
- 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,346
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
- 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,252
- 2023A Survey on Evaluation of Large Language Modelscited by 1,242
- 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
- 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,202
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,195
- 2023PaLM 2 Technical Reportcited by 1,162
- 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,135
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 952
- 2021An Explanation of In-context Learning as Implicit Bayesian Inferencecited by 938
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 916
- 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 897
- 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 867
- 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 843
- 2023RWKV: Reinventing RNNs for the Transformer Eracited by 827
- 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 819
- 2023Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedbackcited by 812
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
50 most cited of 2,955 All 2,955 (JSON)
- 2026AFCS: Atomic-Fact-Conditioned Synthesis for Factual Knowledge Pretraining14 Oct 2026
- 2026MAPLE: A Multi-Axis Parametric Knowledge Extraction Lens for LLM Evaluation14 Oct 2026
- 2026RouteWeaver: Weaving Mode Selection and Execution into Unified LLM Routing14 Oct 2026
- 2026C3: Rethinking Process Supervision via Confidence-Guided Credit Correction in Multi-Turn Reinforcement Learning14 Oct 2026
- 2026Model What Matters: Decision-Guided Selective World Modeling for Language Agents14 Oct 2026
- 2026More Than Seeing: Vision as Scalable Anchors in Native Multimodal Pre-Training14 Oct 2026
- 2026Evaluating Compressed Memory: Dependence, Utility, and Content Benefit14 Oct 2026
- 2026Empathy Is Not the Scapegoat for Declines in Factuality and Reliability13 Oct 2026
- 2026Do Factuality Methods Make LLMs More Factual? Reproducibility and Fair Comparison13 Oct 2026
- 2026Claim Framing as a Driver of LLM Sycophancy13 Oct 2026
- 2026Monitoring latent reasoning in looped language models13 Oct 2026
- 2026ChampionKV: Head-Wise Adaptive Budget Allocation for KV Cache Compression13 Oct 2026
38 more
- 2026Confine to the Task, Anchor the Rest: Concept-Guided Retention Regularizer for Parameter-Efficient Fine-Tuning13 Oct 2026
- 2026The Multilingual Artificial Hivemind: Do All LLMs Think Alike in Every Language?12 Oct 2026
- 2026Strong yet Controllable LLM Abstention without Learning to Abstain12 Oct 2026
- 2026RSIPO: Recursive Self-Improving Policy Optimization for Agentic Reinforcement Learning via Skill-Policy Co-Evolution11 Oct 2026
- 2026Preserving Updates in Low-Bit Recurrent State Quantization11 Oct 2026
- 2026Sequent-Prover: Training Agents for Formal, Checkable SMT-based Reasoning11 Oct 2026
- 2026SAFE-KV: Causal Suffix Repair for Behavior-Preserving Non-Prefix KV Cache Reuse in RAG10 Oct 2026
- 2026Embedding Graph Kernel Entropy (EGKE): Fine-grained Hallucination Detection for LLMs from Embeddings9 Oct 2026
- 2026Can Language Models Learn When to Abstain? Policy Learning and Calibrated Answer Selection9 Oct 2026
- 2026Orthros: Phase-Aware Heterogeneous Attention for Efficient Transformers9 Oct 2026
- 2026Branching On-Policy Distillation9 Oct 2026
- 2026Understanding Mamba-3 Through Oscillatory Dynamics9 Oct 2026
- 2026SOAR: Source-Aware Reinforcement Learning with Precise Credit Assignment for Search Agents9 Oct 2026
- 2026SEEDS: Preview-Guided Evidence Admission for Search Agents9 Oct 2026
- 2026COFFEQA: Counterfactual-Guided Few-Shot Distillation for LLM Question Answering9 Oct 2026
- 2026TreeHCA: Hindsight-Guided Exploration and Credit Assignment for Multi-Turn LLM Agents9 Oct 2026
- 2026One Model, Multiple Compute Budgets: Multi-Ratio ConceptMoE for Flexible Compute Across Turns8 Oct 2026
- 2026DivMoE: Fine-Grained MoE Upcycling via Cross-Domain Expert Composition8 Oct 2026
- 2026KDFP: A first-principles approach to knowledge distillation in large language models7 Oct 2026
- 2026COPC: Coupled Off-Policy Correction for Asynchronous LLM Reinforcement Learning7 Oct 2026
- 2026Structured but Silent: Probing Capability Requirements in LLM Hidden States6 Oct 2026
- 2026PERSIST: Who-What-When Memory Across Sessions for Full-Duplex Spoken Dialogue6 Oct 2026
- 2026Spectral Geometry of Attention: From Information Routing to Uncertainty5 Oct 2026
- 2026A Testable Theory of Atomic Features5 Oct 2026
- 2026Voltic: Distinguishing Volatility from Stochasticity in Recurrent Memory5 Oct 2026
- 2026More Than Words: Compositional Tokenization for Efficient Language Models4 Oct 2026
- 2026Hallucination Across the Reasoning Lifecycle: Interface Visibility, Causal Evidence, and Release Control in Large Reasoning Models4 Oct 2026
- 2026Robust Parameter-Efficient LLM Adaptation on Analog Hardware4 Oct 2026
- 2026Beyond Instruction Following: Learning Grounded Skill-Following with Skill Contracts4 Oct 2026
- 2026Correctness Is a Direction: Geometric Answer Selection in Language Models3 Oct 2026
- 2026Reactivating Alignment: Defending LLMs from Jailbreaks via Intention-Aware Input-Output Matching3 Oct 2026
- 2026Principled Top-k Selection for Language Models with Hybrid Gradients3 Oct 2026
- 2026SCAD: Structured Credit Assignment and Distillation for Long-Horizon Agents2 Oct 2026
- 2026The Geometry of Knowledge Accessibility in Large Language Models2 Oct 2026
- 2026Output Language Confusion under Multilingual Prompt Contamination2 Oct 2026
- 2026Dynamic LLM Routers are Often Misguided2 Oct 2026
- 2026Test-time Calibration Learning for Large Language Model Reasoning2 Oct 2026
- 2026Online Verification of Language Model Responses Under Cost Constraints2 Oct 2026
50 newest of 2,955 All 2,955 (JSON)
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 952
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
- 2023In-Context Retrieval-Augmented Language Modelscited by 702
- 2023Active Retrieval Augmented Generationcited by 516
- 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexitycited by 451
- 2024Graph Retrieval-Augmented Generation: A Surveycited by 324
- 2023RECOMP: Improving Retrieval-Augmented LMs with Compression and Selective Augmentationcited by 256
- 2025Agentic Retrieval-Augmented Generation: A Survey on Agentic RAGcited by 249
- 2024RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMscited by 202
- 2023RA-DIT: Retrieval-Augmented Dual Instruction Tuningcited by 195
12 most cited of 413 All 413 (JSON)
- 2026SAFE-KV: Causal Suffix Repair for Behavior-Preserving Non-Prefix KV Cache Reuse in RAG10 Oct 2026
- 2026Principled Top-k Selection for Language Models with Hybrid Gradients3 Oct 2026
- 2026Output Language Confusion under Multilingual Prompt Contamination2 Oct 2026
- 2026Bridging Semantic Gaps in RAG through Generated Context Knowledge Fusion29 Sep 2026
- 2026CacheRepair: Learning to Repair Cross-Chunk Context in RAG for KV Cache Fusion28 Sep 2026
- 2026Conformal Factuality Control for Multi-Hop Retrieval-Augmented Generation27 Sep 2026
- 2026Backdoor in the Loop: Compromising Agentic Search via Malicious Retrievers26 Sep 2026
- 2026Regime Boundary Alignment for Evidence-Gated Question Answering25 Sep 2026
- 2026Return or Revise? Learning When Revision Helps Retrieval-Augmented QA24 Sep 2026
- 2026Only Pay What You Must Spend: On-Demand Privacy Budget Payment for Differentially Private RAG23 Sep 2026
- 2026One Size Does Not Fit All! Dynamic Retriever and Generator Selection for RAG15 Sep 2026
- 2026Atlas: Efficient Verifiable Semantic Search10 Sep 2026
12 newest of 413 All 413 (JSON)
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2022Language Models (Mostly) Know What They Knowcited by 1,856
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2023PaLM 2 Technical Reportcited by 1,162
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
- 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 642
- 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 497
- 2025Search-o1: Agentic Search-Enhanced Large Reasoning Modelscited by 433
- 2025DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environmentscited by 286
12 most cited of 271 All 271 (JSON)
- 2026C3: Rethinking Process Supervision via Confidence-Guided Credit Correction in Multi-Turn Reinforcement Learning14 Oct 2026
- 2026Monitoring latent reasoning in looped language models13 Oct 2026
- 2026The Multilingual Artificial Hivemind: Do All LLMs Think Alike in Every Language?12 Oct 2026
- 2026SOAR: Source-Aware Reinforcement Learning with Precise Credit Assignment for Search Agents9 Oct 2026
- 2026SEEDS: Preview-Guided Evidence Admission for Search Agents9 Oct 2026
- 2026TreeHCA: Hindsight-Guided Exploration and Credit Assignment for Multi-Turn LLM Agents9 Oct 2026
- 2026Hallucination Across the Reasoning Lifecycle: Interface Visibility, Causal Evidence, and Release Control in Large Reasoning Models4 Oct 2026
- 2026Test-time Calibration Learning for Large Language Model Reasoning2 Oct 2026
- 2026Mapping the RAG Landscape: A Four Axis Taxonomy of Efficiency, Defense, Interactivity, and Reasoning1 Oct 2026
- 2026Diversity Combining for Multi-Path LLM Reasoning30 Sep 2026
- 2026Trajectory Soup: Pushing the Compute-Scaling Frontier of LLM Mid-training via Diverse Trajectories29 Sep 2026
- 2026FocusVTC: Efficient and High-Performance Visual Text Compression with Adaptive Resolution29 Sep 2026
12 newest of 271 All 271 (JSON)
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
- 2025Kimi K2: Open Agentic Intelligencecited by 567
- 2022Improving alignment of dialogue agents via targeted human judgementscited by 531
- 2023ToolQA: A Dataset for LLM Question Answering with External Toolscited by 274
- 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaborationcited by 251
- 2023AutoAgents: A Framework for Automatic Agent Generationcited by 216
- 2025BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agentcited by 200
- 2025Beyond Ten Turns: Unlocking Long-Horizon Agentic Search with Large-Scale Asynchronous RLcited by 150
- 2025EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecyclecited by 137
- 2025Deep Research Agents: A Systematic Examination And Roadmapcited by 128
- 2025Memento: Fine-tuning LLM Agents without Fine-tuning LLMscited by 127
12 most cited of 197 All 197 (JSON)
- 2026RSIPO: Recursive Self-Improving Policy Optimization for Agentic Reinforcement Learning via Skill-Policy Co-Evolution11 Oct 2026
- 2026Sequent-Prover: Training Agents for Formal, Checkable SMT-based Reasoning11 Oct 2026
- 2026My FAULT: Self-Diagnosis as Credit Assignment in Self-Evolving Agentic Reinforcement Learning1 Oct 2026
- 2026SkillFM: Generating Skills for LLM Agents via Latent Flow Matching30 Sep 2026
- 2026CollabFlow: Recursive Self-Improvement of Agent Collaboration29 Sep 2026
- 2026EvoSteer: Online Self-Evolving Graph Orchestration via Reference-Anchored Credit Assignment29 Sep 2026
- 2026Learning from Viable Failure Prefixes: Milestone Viability Potential Policy Optimization for Long-Horizon LLM Agents29 Sep 2026
- 2026BRIDGE: Bilevel Retrieval-Credit-Aware Agentic Reinforcement Learning29 Sep 2026
- 2026LLMs Learn to Evade Latent Monitors from Prior Feedback Alone29 Sep 2026
- 2026TokenCast: Forecasting Token Consumption During LLM Agent Execution28 Sep 2026
- 2026SALMONN-duo: Adaptive Dual-System Coordination for Full-Duplex Voice Agents28 Sep 2026
- 2026R2 Flow: Recursive Self-Improvement via Recursive Skill Evolution27 Sep 2026
12 newest of 197 All 197 (JSON)
- 2024Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inferencecited by 501
- 2024PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funnelingcited by 432
- 2024Ada-KV: Optimizing KV Cache Eviction by Adaptive Budget Allocation for Efficient LLM Inferencecited by 235
- 2023CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Servingcited by 203
- 2023SparQ Attention: Bandwidth-Efficient LLM Inferencecited by 119
- 2025KVLink: Accelerating Large Language Models via Efficient KV Cache Reusecited by 66
- 2024Palu: Compressing KV-Cache with Low-Rank Projectioncited by 64
- 2025ChunkKV: Semantic-Preserving KV Cache Compression for Efficient Long-Context LLM Inferencecited by 60
- 2024500xCompressor: Generalized Prompt Compression for Large Language Modelscited by 47
- 2024NACL: A General and Effective KV Cache Eviction Framework for LLMs at Inference Timecited by 43
- 2024DynamicKV: Task-Aware Adaptive KV Cache Compression for Long Context LLMscited by 42
- 2021TR-BERT: Dynamic Token Reduction for Accelerating BERT Inferencecited by 40
12 most cited of 82 All 82 (JSON)
- 2026ChampionKV: Head-Wise Adaptive Budget Allocation for KV Cache Compression13 Oct 2026
- 2026ARC-KV: Amortizing Anchor Search for Reconstruction-Based KV Cache Compaction29 Sep 2026
- 2026When to Evict, Not What to Keep: Draft-Guided Eviction for Training-Free KV-Cache Compression27 Sep 2026
- 2026Evaluating the accuracy of KV cache reuse techniques25 Sep 2026
- 2026HySparse2: Hybrid Sparse Attention with Two-Level KV Sharing22 Sep 2026
- 2026FlexEE: Self-Speculative and KV-Compatible Early Exiting for Offloading-Aware LLM Inference15 Sep 2026
- 2026mzCache: On-Device LLM Memory Management under Multitasking1 Sep 2026
- 2026Task-Aware Spectral Pruning: A Mixture-of-Masks Framework for Efficient LLM Inference24 Aug 2026
- 2026Coverage-Driven KV Cache Eviction for Efficient and Improved Inference of LLM28 Jun 2026
- 2026KVEraser: Learning to Steer KV Cache for Efficient Localized Context Erasing15 Jun 2026
- 2026VIA-SD: Verification via Intra-Model Routing for Speculative Decoding10 Jun 2026
- 2026End-to-End Context Compression at Scale8 Jun 2026
12 newest of 82 All 82 (JSON)
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
- 2024Mixtral of Expertscited by 1,823
- 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,135
- 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 867
- 2025Muon is Scalable for LLM Trainingcited by 428
- 2022DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scalecited by 404
- 2022ST-MoE: Designing Stable and Transferable Sparse Expert Modelscited by 399
- 2024DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligencecited by 331
- 2026MiMo-V2-Flash Technical Reportcited by 191
- 2024OpenMoE: An Early Effort on Open Mixture-of-Experts Language Modelscited by 187
- 2024Hunyuan-Large: An Open-Source MoE Model with 52 Billion Activated Parameters by Tencentcited by 90
- 2026Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Modelscited by 86
12 most cited of 79 All 79 (JSON)
- 2026One Model, Multiple Compute Budgets: Multi-Ratio ConceptMoE for Flexible Compute Across Turns8 Oct 2026
- 2026DivMoE: Fine-Grained MoE Upcycling via Cross-Domain Expert Composition8 Oct 2026
- 2026Harnessing Domain Specialists in Multimodal Mixture-of-Experts for Efficient Adaptation1 Oct 2026
- 2026Scaling Laws for Looped Mixture of Experts30 Sep 2026
- 2026MoRE: Scaling mixture of experts with hardware-aware low-rank routing28 Sep 2026
- 2026Function Over Form: Distributional Orthogonalization in Mixture-of-Experts with Replica Expert Mechanism26 Sep 2026
- 2026Exact Quantile Balancing and Load-Error Injection for Mixture-of-Experts23 Sep 2026
- 2026Instella-MoE Technical Report1 Sep 2026
- 2026HiVe: Beyond Static Prompts for Multitask Learning via Hierarchy-based Vertical Mixture-of-Experts30 Aug 2026
- 2026Redesign Mixture-of-Experts Routers with Manifold Power Iteration10 Jun 2026
- 2026LoopMoE: Unifying Iterative Computation with Mixture-of-Experts for Language Modeling3 Jun 2026
- 2026MobileMoE: Scaling On-Device Mixture of Experts26 May 2026
12 newest of 79 All 79 (JSON)
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
- 2023Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedbackcited by 812
- 2023UltraFeedback: Boosting Language Models with Scaled AI Feedbackcited by 406
- 2023Chain of Hindsight Aligns Language Models with Feedbackcited by 148
- 2023Improving Language Models via Plug-and-Play Retrieval Feedbackcited by 87
- 2024Unfamiliar Finetuning Examples Control How Language Models Hallucinatecited by 87
- 2023Alignment for Honestycited by 74
- 2024Rejection Improves Reliability: Training LLMs to Refuse Unknown Questions Using RL from Knowledge Feedbackcited by 66
- 2024Aligning LLMs with Individual Preferences via Interactioncited by 63
- 2024Calibrating Language Models with Adaptive Temperature Scalingcited by 58
- 2024Learn Your Reference Model for Real Good Alignmentcited by 57
12 most cited of 56 All 56 (JSON)
- 2026Do Factuality Methods Make LLMs More Factual? Reproducibility and Fair Comparison13 Oct 2026
- 2026The Alignment Paradox: How Post-Training Amplifies Confident Hallucinations in Language Models26 Sep 2026
- 2026Hallucination Neurons and Where to Find Them: An Investigation into the existence of Hallucination Neurons24 Sep 2026
- 2026The Geometry of Refusal: Why Post-Hoc Safety Is Fragile and Pretraining-Time Safety Persists7 Sep 2026
- 2026CAFE: Self-Improving Search Agents Need Co-Evolving Feedback25 Aug 2026
- 2026aiXamine: Unified Black-Box Evaluation of Cross-Dimensional Trade-offs in LLM Safety, Security, and Privacy20 Aug 2026
- 2026Same Semantics, Different Paths: Self-Improving Alignment for Vision-Text Compression3 Aug 2026
- 2026Turning Off-Policy Tokens On-Policy: A Plug-in Approach for Improving LLM Alignment6 Jul 2026
- 2026Aligning Language Models with Selective Prediction3 Jul 2026
- 2026SAGE: Answer-Conditioned Uncertainty Targets for Verbal Uncertainty Alignment9 Jun 2026
- 2026From "Weak" Signals to Strong Models: Preference Delta Aggregation with LoRA Merging29 May 2026
- 2026Know When You're Wrong: Aligning Confidence with Correctness for LLM Error Detection18 Feb 2026
12 newest of 56 All 56 (JSON)
- 2023A Watermark for Large Language Modelscited by 725
- 2024Rainbow Teaming: Open-Ended Generation of Diverse Adversarial Promptscited by 205
- 2023A Survey of Text Watermarking in the Era of Large Language Modelscited by 112
- 2023Three Bricks to Consolidate Watermarks for Large Language Modelscited by 84
- 2024Catastrophic Failure of LLM Unlearning via Quantizationcited by 81
- 2024RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Modelscited by 78
- 2023Evaluating the Instruction-Following Robustness of Large Language Models to Prompt Injectioncited by 59
- 2024Watermarking Makes Language Models Radioactivecited by 58
- 2024A Closer Look at Machine Unlearning for Large Language Modelscited by 56
- 2025Can Indirect Prompt Injection Attacks Be Detected and Removed?cited by 52
- 2025A Comprehensive Survey of Machine Unlearning Techniques for Large Language Modelscited by 34
- 2024Protecting Your LLMs with Information Bottleneckcited by 29
12 most cited of 56 All 56 (JSON)
- 2026Reactivating Alignment: Defending LLMs from Jailbreaks via Intention-Aware Input-Output Matching3 Oct 2026
- 2026Confess What You Know: Forget-Set Misalignment with Model Knowledge in LLM Unlearning1 Sep 2026
- 2026Confidently Wrong, Silently So: Auditing Undetectable Failures of a Deployed On-Device Language Model24 Aug 2026
- 2026On the Hidden Costs of Counterfactual Knowledge Training in LLM Unlearning26 May 2026
- 2026DualOptim+: Bridging Shared and Decoupled Optimizer States for Better Machine Unlearning in Large Language Models20 May 2026
- 2026Beyond Fixed Benchmarks and Worst-Case Attacks: Dynamic Boundary Evaluation for Language Models7 May 2026
- 2026CURaTE: Continual Unlearning in Real Time with Ensured Preservation of LLM Knowledge16 Apr 2026
- 2026BackFlush: Knowledge-Free Backdoor Detection and Elimination with Watermark Preservation in Large Language Models15 Apr 2026
- 2026Large Language Models Generate Harmful Responses Using a Distinct Mechanism, Shared Across Harm Types10 Apr 2026
- 2026Analysing the Safety Pitfalls of Steering Vectors25 Mar 2026
- 2026Revisiting Backdoor Threat in Federated Instruction Tuning from a Signal Aggregation Perspective17 Feb 2026
- 2026Inhibitory Attacks on Backdoor-based Fingerprinting for Large Language Models7 Jan 2026
12 newest of 56 All 56 (JSON)
- 2024MM1: Methods, Analysis & Insights from Multimodal LLM Pre-trainingcited by 232
- 2024GME: Improving Universal Multimodal Retrieval by Multimodal LLMscited by 170
- 2024FlashRAG: A Modular Toolkit for Efficient Retrieval-Augmented Generation Researchcited by 166
- 2024Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLMcited by 141
- 2025MinMo: A Multimodal Large Language Model for Seamless Voice Interactioncited by 79
- 2026MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interactioncited by 78
- 2023Can Language Models be Instructed to Protect Personal Information?cited by 46
- 2025RzenEmbed: Towards Comprehensive Multimodal Retrievalcited by 29
- 2024Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Modelscited by 28
- 2024SPORTU: A Comprehensive Sports Understanding Benchmark for Multimodal Large Language Modelscited by 24
- 2024Sample then Identify: A General Framework for Risk Control and Assessment in Multimodal Large Language Modelscited by 19
- 2025Head Pursuit: Probing Attention Specialization in Multimodal Transformerscited by 17
12 most cited of 31 All 31 (JSON)
- 2026BiG-SURE - Bipartite Graph for Semantic Uncertainty and Reliability Estimation of LLMs31 Aug 2026
- 2026Pro-Router: Token-Aware Progressive Model Routing with Adaptive Edge-Cloud Collaboration for Efficient Multimodal LLM Inference28 Aug 2026
- 2026Beyond the Current Observation: Evaluating Multimodal Large Language Models in Controllable Non-Markov Games17 Jun 2026
- 2026Magnifying What Matters: Attention-Guided Adaptive Rendering for Visual Text Comprehension11 Jun 2026
- 2026Leveraging Visual Signals for Robust Token-Level Uncertainty in Vision-Language Generation26 May 2026
- 2026MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interaction30 Apr 2026
- 2026AQuA: Toward Strategic Response Generation for Ambiguous Visual Questions8 Mar 2026
- 2026Lyapunov Probes for Hallucination Detection in Large Foundation Models6 Mar 2026
- 2026VLM-UQBench: A Benchmark for Modality-Specific and Cross-Modality Uncertainties in Vision Language Models9 Feb 2026
- 2026WorldVQA: Measuring Atomic World Knowledge in Multimodal Large Language Models28 Jan 2026
- 2026Pixel-Grounded Retrieval for Knowledgeable Large Multimodal Models27 Jan 2026
- 2026MoST: Mixing Speech and Text with Modality-Aware Mixture of Experts15 Jan 2026
12 newest of 31 All 31 (JSON)
- 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Modelscited by 274
- 2025LLaDA2.0: Scaling Up Diffusion Language Models to 100Bcited by 166
- 2025SDAR: A Synergistic Diffusion-AutoRegression Paradigm for Scalable Sequence Generationcited by 129
- 2025Path Planning for Masked Diffusion Model Samplingcited by 80
- 2026LLaDA2.1: Speeding Up Text Diffusion via Token Editingcited by 54
- 2024A Survey on Data Augmentation in Large Model Eracited by 31
- 2025TESS 2: A Large-Scale Generalist Diffusion Language Modelcited by 30
- 2026Parallelism and Generation Order in Masked Diffusion Language Models: Limits Today, Potential Tomorrowcited by 11
- 2026TDGNet: Hallucination Detection in Diffusion Language Models via Temporal Dynamic Graphscited by 8
- 2026Autoregressive Models Rival Diffusion Models at ANY-ORDER Generationcited by 4
- 2026OSCAR: Orchestrated Self-verification and Cross-path Refinementcited by 2
- 2026LoSA: Locality Aware Sparse Attention for Block-Wise Diffusion Language Modelscited by 2
12 most cited of 25 All 25 (JSON)
- 2026Reducing Pretraining-Generation Mismatch in Diffusion Language Models10 Aug 2026
- 2026Unsure but Certain: Uncovering the Representation-Confidence Gap in Diffusion Language Models9 Aug 2026
- 2026Beyond the Bidirectional Promise: Re-evaluating the Robustness of Diffusion Language Models29 Jul 2026
- 2026DeMTS: Denoising Trajectories as Multivariate Time Series for Hallucination Detection in Diffusion Language Models24 Jul 2026
- 2026TRE: Training-Free Hallucination Detection for Diffusion Language Models29 Jun 2026
- 2026Self-Generated Error Training for Token Editing in Diffusion Language Models15 Jun 2026
- 2026SimSD: Simple Speculative Decoding in Diffusion Language Models1 Jun 2026
- 2026Uncertainty Quantification for Large Language Diffusion Models14 May 2026
- 2026Understanding and Accelerating the Training of Masked Diffusion Language Models13 May 2026
- 2026Remask, Don't Replace: Token-to-Mask Refinement in Diffusion Language Models20 Apr 2026
- 2026LoSA: Locality Aware Sparse Attention for Block-Wise Diffusion Language Models13 Apr 2026
- 2026Targeted Remasking: Replacing Token Editing with Token-to-Mask Refinement in Discrete Diffusion Language Models6 Apr 2026
12 newest of 25 All 25 (JSON)
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
- 2026Privileged Information Distillation for Language Modelscited by 90
- 2025Position Bias Mitigates Position Bias:Mitigate Position Bias Through Inter-Position Knowledge Distillationcited by 9
- 2026π-Play: Multi-Agent Self-Play via Privileged Self-Distillation without External Datacited by 7
- 2021Improving Question Answering Performance Using Knowledge Distillation and Active Learningcited by 6
- 2026SD-Search: On-Policy Hindsight Self-Distillation for Search-Augmented Reasoningcited by 5
- 2025LEAF: Knowledge Distillation of Text Embedding Models with Teacher-Aligned Representationscited by 4
- 2026Semantic Self-Distillation for Language Model Uncertaintycited by 4
- 2026Self-Distillation for Multi-Token Predictioncited by 4
- 2023ERNIE 3.0 Tiny: Frustratingly Simple Method to Improve Task-Agnostic Distillation Generalizationcited by 3
- 2025MobileLLM-Pro Technical Reportcited by 3
- 2023Efficient Transformer Knowledge Distillation: A Performance Reviewcited by 2
12 most cited of 19 All 19 (JSON)
- 2026Branching On-Policy Distillation9 Oct 2026
- 2026COFFEQA: Counterfactual-Guided Few-Shot Distillation for LLM Question Answering9 Oct 2026
- 2026KDFP: A first-principles approach to knowledge distillation in large language models7 Oct 2026
- 2026PivotOPD: Learning to Recover from Pivotal Mistakes in Multi-Turn Agents30 Sep 2026
- 2026Beyond Timestamps: Decision-Aligned On-Policy Distillation for Long-Horizon Agents27 Sep 2026
- 2026HindSearch: Trajectory-Level Hindsight Critique for Search-Augmented Reinforcement Learning3 Aug 2026
- 2026Unveil: Unified Visual-Textual Integration and Distillation for Multi-modal Document Retrieval23 May 2026
- 2026SD-Search: On-Policy Hindsight Self-Distillation for Search-Augmented Reasoning18 May 2026
- 2026π-Play: Multi-Agent Self-Play via Privileged Self-Distillation without External Data15 Apr 2026
- 2026Self-Distillation for Multi-Token Prediction25 Mar 2026
- 2026Privileged Information Distillation for Language Models4 Feb 2026
- 2026Semantic Self-Distillation for Language Model Uncertainty4 Feb 2026
12 newest of 19 All 19 (JSON)
- 2024SELF-[IN]CORRECT: LLMs Struggle with Discriminating Self-Generated Responsescited by 26
- 2025Open Data Synthesis For Deep Researchcited by 16
- 2025Calibrating Verbalized Confidence with Self-Generated Distractorscited by 14
- 2024Prompting-based Synthetic Data Generation for Few-Shot Question Answeringcited by 9
- 2026SCOPE: Self-Play via Co-Evolving Policies for Open-Ended Taskscited by 7
- 2025Synthetic bootstrapped pretrainingcited by 6
- 2026Bootstrapping Post-training Signals for Open-ended Tasks via Rubric-based Self-play on Pre-training Textcited by 5
- 2025The Curious Case of Factuality Finetuning: Models' Internal Beliefs Can Improve Factualitycited by 4
- 2024SoftSRV: Learn to Generate Targeted Synthetic Datacited by 3
- 2025Self-Improving Model Steeringcited by 3
- 2025Grounding Synthetic Data Evaluations of Language Models in Unsupervised Document Corporacited by 2
- 2025Robust Uncertainty Quantification for Self-Evolving Large Language Models via Continual Domain Pretrainingcited by 2
12 most cited of 15 All 15 (JSON)
- 2026SCOPE: Self-Play via Co-Evolving Policies for Open-Ended Tasks29 May 2026
- 2026Bootstrapping Post-training Signals for Open-ended Tasks via Rubric-based Self-play on Pre-training Text21 Apr 2026
- 2026Continually self-improving AI18 Mar 2026
- 2026FineInstructions: Scaling Synthetic Instructions to Pre-Training Scale29 Jan 2026
- 2025BhashaKritika: Building Synthetic Pretraining Data at Scale for Indic Languages13 Nov 2025
- 2025Robust Uncertainty Quantification for Self-Evolving Large Language Models via Continual Domain Pretraining27 Oct 2025
- 2025Calibrating Verbalized Confidence with Self-Generated Distractors29 Sep 2025
- 2025Synthetic bootstrapped pretraining17 Sep 2025
- 2025Open Data Synthesis For Deep Research30 Aug 2025
- 2025Self-Improving Model Steering11 Jul 2025
- 2025The Curious Case of Factuality Finetuning: Models' Internal Beliefs Can Improve Factuality11 Jul 2025
- 2025Grounding Synthetic Data Evaluations of Language Models in Unsupervised Document Corpora13 May 2025
12 newest of 15 All 15 (JSON)
- 2023Do Androids Know They're Only Dreaming of Electric Sheep?cited by 67
- 2024Semantics-Adaptive Activation Intervention for LLMs via Dynamic Steering Vectorscited by 63
- 2025No Answer Needed: Predicting LLM Answer Accuracy from Question-Only Linear Probescited by 38
- 2025Steering When Necessary: Flexible Steering Large Language Models with Backtrackingcited by 8
- 2026Closing the Confidence-Faithfulness Gap in Large Language Modelscited by 8
- 2024Wasserstein Distances, Neuronal Entanglement, and Sparsitycited by 6
- 2026Detection Without Correction: A Robust Asymmetry in Activation-Based Hallucination Probingcited by 2
- 2026Prompt Embedding Probes (PEP): Hallucination Detection in LLMs from Hidden Statescited by 2
- 2024A Timeline and Analysis for Representation Plasticity in Large Language Modelscited by 0
- 2025Bridging Compositional and Distributional Semantics: A Survey on Latent Semantic Geometry via AutoEncodercited by 0
- 2026Safety Cost of Steering Vectors Is Separable and Reduciblecited by 0
- 2026How Do Linear Probes Emerge? A Circuit-Tracing Framework with Concept-Targeted Attributioncited by 0
12 most cited of 14 All 14 (JSON)
- 2026MAPLE: A Multi-Axis Parametric Knowledge Extraction Lens for LLM Evaluation14 Oct 2026
- 2026A Testable Theory of Atomic Features5 Oct 2026
- 2026How Do Linear Probes Emerge? A Circuit-Tracing Framework with Concept-Targeted Attribution27 Aug 2026
- 2026Safety Cost of Steering Vectors Is Separable and Reducible9 Aug 2026
- 2026Prompt Embedding Probes (PEP): Hallucination Detection in LLMs from Hidden States8 Aug 2026
- 2026Closing the Confidence-Faithfulness Gap in Large Language Models26 Mar 2026
- 2026Detection Without Correction: A Robust Asymmetry in Activation-Based Hallucination Probing20 Mar 2026
- 2025No Answer Needed: Predicting LLM Answer Accuracy from Question-Only Linear Probes12 Sep 2025
- 2025Steering When Necessary: Flexible Steering Large Language Models with Backtracking25 Aug 2025
- 2025Bridging Compositional and Distributional Semantics: A Survey on Latent Semantic Geometry via AutoEncoder25 Jun 2025
- 2024Semantics-Adaptive Activation Intervention for LLMs via Dynamic Steering Vectors16 Oct 2024
- 2024A Timeline and Analysis for Representation Plasticity in Large Language Models8 Oct 2024
12 newest of 14 All 14 (JSON)
- 2024An Empirical Study of Mamba-based Language Modelscited by 186
- 2024Unlocking State-Tracking in Linear RNNs Through Negative Eigenvaluescited by 101
- 2024Longhorn: State Space Models are Amortized Online Learnerscited by 59
- 2026Gated DeltaNet-2: Decoupling Erase and Write in Linear Attentioncited by 33
- 2025Mamba Modulation: On the Length Generalization of Mambacited by 16
- 2025Hybrid Architectures for Language Models: Systematic Analysis and Design Insightscited by 14
- 2025Understanding and Enhancing Mamba-Transformer Hybrids for Memory Recall and Language Modelingcited by 5
- 2025DYNAMAX: Dynamic computing for Transformers and Mamba based architecturescited by 3
- 2026Interpreting and Steering State-Space Models via Activation Subspace Bottleneckscited by 3
- 2026DART: Decoded Attention over Recurrent States for Efficient Long-Context Sequence Modelingcited by 2
- 2026Understanding Mamba-3 Through Oscillatory Dynamicscited by 0
- 2026Understanding Mamba-3 Through Oscillatory Dynamics9 Oct 2026
- 2026DART: Decoded Attention over Recurrent States for Efficient Long-Context Sequence Modeling3 Aug 2026
- 2026Gated DeltaNet-2: Decoupling Erase and Write in Linear Attention21 May 2026
- 2026Interpreting and Steering State-Space Models via Activation Subspace Bottlenecks26 Feb 2026
- 2025Understanding and Enhancing Mamba-Transformer Hybrids for Memory Recall and Language Modeling30 Oct 2025
- 2025Hybrid Architectures for Language Models: Systematic Analysis and Design Insights6 Oct 2025
- 2025Mamba Modulation: On the Length Generalization of Mamba23 Sep 2025
- 2025DYNAMAX: Dynamic computing for Transformers and Mamba based architectures29 Apr 2025
- 2024Unlocking State-Tracking in Linear RNNs Through Negative Eigenvalues19 Nov 2024
- 2024Longhorn: State Space Models are Amortized Online Learners19 Jul 2024
- 2024An Empirical Study of Mamba-based Language Models12 Jun 2024
- 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 897
- 2023WorldSense: A Synthetic Benchmark for Grounded Reasoning in Large Language Modelscited by 20
- 2026Policy and World Modeling Co-Training for Language Agentscited by 15
- 2024From Efficient Multimodal Models to World Models: A Surveycited by 13
- 2026Internalizing the Future: A Unified Agentic Training Paradigm for World Model Planningcited by 3
- 2026EVOKE: Eliciting World Knowledge in Agents for Transferable Decision-Makingcited by 0
- 2026Model What Matters: Decision-Guided Selective World Modeling for Language Agentscited by 0
- 2026Model What Matters: Decision-Guided Selective World Modeling for Language Agents14 Oct 2026
- 2026EVOKE: Eliciting World Knowledge in Agents for Transferable Decision-Making29 Sep 2026
- 2026Internalizing the Future: A Unified Agentic Training Paradigm for World Model Planning25 Jun 2026
- 2026Policy and World Modeling Co-Training for Language Agents1 Jun 2026
- 2024From Efficient Multimodal Models to World Models: A Survey27 Jun 2024
- 2023WorldSense: A Synthetic Benchmark for Grounded Reasoning in Large Language Models27 Nov 2023
- 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Experts13 Dec 2021
- 2025Kimi Linear: An Expressive, Efficient Attention Architecturecited by 196
- 2025Kimi Linear: An Expressive, Efficient Attention Architecture30 Oct 2025
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2023Mistral 7Bcited by 3,164
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2023A Survey of Large Language Modelscited by 2,576
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
12 most cited of 1,678 All 1,678 (JSON)
- 2026AFCS: Atomic-Fact-Conditioned Synthesis for Factual Knowledge Pretraining14 Oct 2026
- 2026RouteWeaver: Weaving Mode Selection and Execution into Unified LLM Routing14 Oct 2026
- 2026More Than Seeing: Vision as Scalable Anchors in Native Multimodal Pre-Training14 Oct 2026
- 2026Evaluating Compressed Memory: Dependence, Utility, and Content Benefit14 Oct 2026
- 2026Empathy Is Not the Scapegoat for Declines in Factuality and Reliability13 Oct 2026
- 2026Claim Framing as a Driver of LLM Sycophancy13 Oct 2026
- 2026Confine to the Task, Anchor the Rest: Concept-Guided Retention Regularizer for Parameter-Efficient Fine-Tuning13 Oct 2026
- 2026Strong yet Controllable LLM Abstention without Learning to Abstain12 Oct 2026
- 2026Preserving Updates in Low-Bit Recurrent State Quantization11 Oct 2026
- 2026Embedding Graph Kernel Entropy (EGKE): Fine-grained Hallucination Detection for LLMs from Embeddings9 Oct 2026
- 2026Can Language Models Learn When to Abstain? Policy Learning and Calibrated Answer Selection9 Oct 2026
- 2026Orthros: Phase-Aware Heterogeneous Attention for Efficient Transformers9 Oct 2026
12 newest of 1,678 All 1,678 (JSON)