SQuAD: 100,000+ Questions for Machine Comprehension of Text
Not on the map. Why?
Cited by 253 in Retrieval-augmented generation, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We present the Stanford Question Answering Dataset (SQuAD), a new reading comprehension dataset consisting of 100,000+ questions posed by crowdworkers on a set of Wikipedia articles, where the answer to each question is a segment of text from the corresponding reading passage. We analyze the dataset to understand the types of reasoning required to answer the questions, leaning heavily on dependency and constituency trees. We build a strong logistic regression model, which achieves an F1 score of 51.0%, a significant improvement over a simple baseline (20%). However, human performance (86.8%) is much higher, indicating that the dataset presents a good challenge problem for future research. The dataset is freely available at https://stanford-qa.com
Key facts. Cited by 4,115 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Jun 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 3; 2021: 700; 2022: 709; 2023: 734; 2024: 773; 2025: 702; 2026: 494.
4,115 papers.
Sort:
By area:
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2023A Survey of Large Language Modelscited by 2,537
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,838
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
38 more
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,234
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2022Editing Models with Task Arithmeticcited by 1,076
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
- 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,026
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 940
- 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 893
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
- 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 776
- 2021Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategiescited by 736
- 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 733
- 2021CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generationcited by 732
- 2022data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Languagecited by 718
- 2024Yi: Open Foundation Models by 01.AIcited by 706
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
- 2022A-OKVQA: A Benchmark for Visual Question Answering using World Knowledgecited by 702
- 2021P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Taskscited by 686
- 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 679
- 2022Large Language Models Can Self-Improvecited by 656
- 2021FLAVA: A Foundational Language And Vision Alignment Modelcited by 646
- 2021SimVLM: Simple Visual Language Model Pretraining with Weak Supervisioncited by 645
- 2023A Comprehensive Overview of Large Language Modelscited by 639
- 2020MOPO: Model-based Offline Policy Optimizationcited by 630
- 2023Bias and Fairness in Large Language Models: A Surveycited by 626
- 2021Merging Models with Fisher-Weighted Averagingcited by 613
- 2023Enabling Large Language Models to Generate Text with Citationscited by 584
- 2023Textbooks Are All You Need II: phi-1.5 technical reportcited by 559
- 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 554
- 2021Editing Factual Knowledge in Language Modelscited by 548
- 2021Datasets: A Community Library for Natural Language Processingcited by 526
- 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
- 2022Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionalitycited by 523
- 2022ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformerscited by 517
- 2024Large Language Models: A Surveycited by 506
50 most cited of 4,115 All 4,115 (JSON)
- 2026TACO: Ternary Absolute-max Column-wise One-sparse Optimizer for LLM Fine-Tuning1 Oct 2026
- 2026Fusing Visual and Textual Representations via Multi-layer Fusing Transformers for Vietnamese Visual Question Answering1 Oct 2026
- 2026Which LLM to pick? Online Active Model Selection for Large Language Models1 Oct 2026
- 2026Efficient Task Adaptation in Large Language Models: A Survey of Weight-Based, Prompt-Based, and Embedding-Based Adaptations1 Oct 2026
- 2026What Should an Agent Remember? Disentangling Retention from Retrieval in Bounded-Memory Evaluation30 Sep 2026
- 2026Inference Auctions30 Sep 2026
- 2026PatchKV: Weight-Space Compensation of KV Cache30 Sep 2026
- 2026HO-FL: Hybrid-Order Federated Learning for Heterogeneous Edge Devices30 Sep 2026
- 2026Pretraining Latent Information Feedback Transformers with Teacher Supervision29 Sep 2026
- 2026Bridging Semantic Gaps in RAG through Generated Context Knowledge Fusion29 Sep 2026
- 2026Beyond Sub-Gaussian Detector Scores: Robust Weighted Profile-Loss Change Point Detection for Human-LLM Text Segmentation29 Sep 2026
- 2026QuantMLA: Function-Aligned Dual-Path Quantization for Low-Bit MLA KV Caching29 Sep 2026
38 more
- 2026BaRe-Mem: Bayesian Reliability Memory for Robust and Adaptive Agent Consultation28 Sep 2026
- 2026Spontaneous Context Restoration: How Language Models Recover from Corrupted Inputs28 Sep 2026
- 2026Coherence-Aware Distributional Evaluation of Open-Ended Text Generation28 Sep 2026
- 2026LA-CPD: Local-Evidence-Aware Change-Point Detection for Human-LLM Authorship Segmentation27 Sep 2026
- 2026Shared Experience, Separate Learning: Companion Confidence Calibration for LLMs27 Sep 2026
- 2026IVT-Guard: All-in-One Reasoning Model for AI-Generated Content Detection27 Sep 2026
- 2026Verification as an Architectural Layer for LLM Agents: A V-Model Design, and a Pilot Study of Its Deterministic Core25 Sep 2026
- 2026HasMem: Hard-Origin Adaptively Softened Memory for Long-Term LLM Agents25 Sep 2026
- 2026HARDEN: Constrained Evolutionary Search for Harder, Answer-Preserving Evaluation Cases24 Sep 2026
- 2026Persuaded, Not Informed: Incentive-Misaligned Witnesses Defeat In-Context Grounding23 Sep 2026
- 2026Reinforcement Learning with Verifiable Rewards for Small Search Agents23 Sep 2026
- 2026The Fellowship of the Query: Learning Retrieval Actions23 Sep 2026
- 2026NGN: Learning Neural Network Size as a Differentiable Count23 Sep 2026
- 2026Compressing Long Context into Answer-Aligned Memory Embeddings for LLM Inference22 Sep 2026
- 2026UniK: Universal Knowledge Perception for Digital and Physical AI21 Sep 2026
- 2026Q-TIE: A Lightweight and Generalizable Re-ranking Framework for Temporal Information Retrieval20 Sep 2026
- 2026ChemCLIR-Bench: Benchmarking Cross-Lingual Information Retrieval in Multilingual Chemical Patents19 Sep 2026
- 2026LLMs as Linguistic Chameleons: Decoupling Semantics and Structure for Privacy-Preserving Communication19 Sep 2026
- 2026AutoGym: Blueprint-First Generation of Verifiable Agent Gyms18 Sep 2026
- 2026Decoupling Internal Representational Changes and Causal Importance in Fine-Tuned Large Language Models17 Sep 2026
- 2026V=akQA: A Benchmark and Evaluation Study for Telugu Spoken Factoid Question Answering17 Sep 2026
- 2026Form Over Content In Gradient-Based Data Attribution Methods17 Sep 2026
- 2026The evolution of sex for artificial intelligence: a population-genetic framework for multigenerational model populations16 Sep 2026
- 2026EviScope: Paired Counterfactual Evidence Diagnostics for Faithful and Efficient Grounded Language Models15 Sep 2026
- 2026Nameless Tokenization: A Lossless Tokenizer-Level Defense Against Control-Token Forgery in Open-Weight LLMs15 Sep 2026
- 2026Can We Trust the Judges? Validation of Factuality Evaluation Methods via Answer Perturbation14 Sep 2026
- 2026MoME: Mixture-of-Memory Embeddings for Context-Aware Sparse Lookup14 Sep 2026
- 2026Towards Evolving Context Parameterization for Large Language Models12 Sep 2026
- 2026GraMRAG: Orchestrating Multi-Agent Multi-Step Reasoning via Graph Memory with Reinforcement Learning12 Sep 2026
- 2026Residual Vector-based Reconstruction as Long-Context Recall Regardless of Context Window Size11 Sep 2026
- 2026Atlas: Efficient Verifiable Semantic Search10 Sep 2026
- 2026Rebalancing Token Importance in Language Models with TF-IDF Weighted Cross-Entropy Loss10 Sep 2026
- 2026NCP-ArchPreview Technical Report: Moving towards Latent Space Language Models through Next Concept Prediction9 Sep 2026
- 2026ConvMem: Convolutional Memory for Long-Context Reasoning9 Sep 2026
- 2026CreaMem: A Scene-Aware Memory Architecture for Personalized Agents8 Sep 2026
- 2026MetaKV: Adaptive KV Cache Compression for Constrained LLM Inference7 Sep 2026
- 2026Merging Cyber Threat Intelligence Through Retrieval-Augmented Generation and Small Language Models for Rich Threat Representation7 Sep 2026
- 2026Continual Learning Mechanisms Compose for Long-Horizon Memorization7 Sep 2026
50 newest of 4,115 All 4,115 (JSON)
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 940
- 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexitycited by 437
- 2022Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLPcited by 316
- 2025Agentic Retrieval-Augmented Generation: A Survey on Agentic RAGcited by 242
- 2024RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMscited by 200
- 2022Improving the Domain Adaptation of Retrieval Augmented Generation (RAG) Models for Open Domain Question Answeringcited by 126
- 2023Encyclopedic VQA: Visual questions about detailed properties of fine-grained categoriescited by 105
- 2024ChatQA: Surpassing GPT-4 on Conversational QA and RAGcited by 90
- 2024FaithEval: Can Your Language Model Stay Faithful to Context, Even If "The Moon is Made of Marshmallows"cited by 85
- 2024BadRAG: Identifying Vulnerabilities in Retrieval Augmented Generation of Large Language Modelscited by 84
- 2024Blended RAG: Improving RAG (Retriever-Augmented Generation) Accuracy with Semantic Search and Hybrid Query-Based Retrieverscited by 83
12 most cited of 235 All 235 (JSON)
- 2026Bridging Semantic Gaps in RAG through Generated Context Knowledge Fusion29 Sep 2026
- 2026The Fellowship of the Query: Learning Retrieval Actions23 Sep 2026
- 2026Q-TIE: A Lightweight and Generalizable Re-ranking Framework for Temporal Information Retrieval20 Sep 2026
- 2026Atlas: Efficient Verifiable Semantic Search10 Sep 2026
- 2026Merging Cyber Threat Intelligence Through Retrieval-Augmented Generation and Small Language Models for Rich Threat Representation7 Sep 2026
- 2026RAGMark: A Comprehensive Framework for Benchmarking Retrieval-Augmented Generation Systems4 Sep 2026
- 2026Retrieved But Not Reliable: A Survey on Attacks, and Defenses in Retrieval-Augmented Generation25 Aug 2026
- 2026W-RAG: Source-Aware Retrieval for Enterprise Document Generation from Heterogeneous Knowledge Bases22 Aug 2026
- 2026Training a Knowledge Base: Supervised Structure Learning for Agent-Curated Document Stores22 Aug 2026
- 2026Semantic Compression Trees: Multi-Resolution Knowledge Retrieval via Hierarchical Semantic Residuals21 Aug 2026
- 2026When Context Misleads: Intent-Guided Decoding for Robust Retrieval-Augmented Generation17 Aug 2026
- 2026LODESTAR: Robust Entropy-Based Answer Selection in Retrieval-Augmented Generation for Question Answering -- Directing Frozen-LLM Entropy with a Reinforcement-Learned Prompt Polarizer under Misleading Passages12 Aug 2026
12 newest of 235 All 235 (JSON)
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
- 2022Large Language Models Can Self-Improvecited by 656
- 2022Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionalitycited by 523
- 2023Think before you speak: Training Language Models With Pause Tokenscited by 254
- 2025MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agentcited by 235
- 2024BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystackcited by 211
- 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 194
- 2022Rethinking with Retrieval: Faithful Large Language Model Inferencecited by 145
- 2024Multi-Step Reasoning with Large Language Models, a Surveycited by 140
- 2024A Survey on Large Language Model Acceleration based on KV Cache Managementcited by 125
- 2025Towards a Science of Scaling Agent Systemscited by 125
12 most cited of 143 All 143 (JSON)
- 2026IVT-Guard: All-in-One Reasoning Model for AI-Generated Content Detection27 Sep 2026
- 2026GraMRAG: Orchestrating Multi-Agent Multi-Step Reasoning via Graph Memory with Reinforcement Learning12 Sep 2026
- 2026ConvMem: Convolutional Memory for Long-Context Reasoning9 Sep 2026
- 2026EvLink: Source-Grounded Evidence Linking for Graph RAG31 Aug 2026
- 2026Metis: Memory Foundation Model29 Jul 2026
- 2026Towards High-Level Semantic Intelligence27 Jul 2026
- 2026Gold-Guided Programmatic Distillation for Financial Reasoning over Hybrid Tables and Text16 Jul 2026
- 2026Doc-to-Atom: Learning to Compile and Compose Memory Atoms10 Jun 2026
- 2026Almieyar-Oryx-BloomBench: A Bilingual Multimodal Benchmark for Cognitively Informed Evaluation of Vision-Language Models4 Jun 2026
- 2026ExpWeaver: LLM Agents Learn from Experience via Latent RAG31 May 2026
- 2026Diagnosing Failure Modes of Shared-State Collaboration in Resource-Constrained Visual Agents29 May 2026
- 2026Better Later Than Sooner: Neuro-Symbolic Knowledge Graph Construction via Ontology-grounded Post-extraction Correction27 May 2026
12 newest of 143 All 143 (JSON)
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
- 2025Evaluation and Benchmarking of LLM Agents: A Surveycited by 145
- 2024AutoWebGLM: A Large Language Model-based Web Navigating Agentcited by 130
- 2025Agentic Large Language Models, a surveycited by 105
- 2024A Review of Large Language Models and Autonomous Agents in Chemistrycited by 96
- 2024Navigating the Risks: A Survey of Security, Privacy, and Ethics Threats in LLM-Based Agentscited by 63
- 2025A Survey of Large Language Model Agents for Question Answeringcited by 46
- 2024LongAgent: Scaling Language Models to 128k Context through Multi-Agent Collaborationcited by 38
- 2024BAGEL: Bootstrapping Agents by Guiding Exploration with Languagecited by 34
- 2026AIRS-Bench: a Suite of Tasks for Frontier AI Research Science Agentscited by 32
- 2025AgentRouter: A Knowledge-Graph-Guided LLM Router for Collaborative Multi-Agent Question Answeringcited by 29
12 most cited of 75 All 75 (JSON)
- 2026Verification as an Architectural Layer for LLM Agents: A V-Model Design, and a Pilot Study of Its Deterministic Core25 Sep 2026
- 2026HasMem: Hard-Origin Adaptively Softened Memory for Long-Term LLM Agents25 Sep 2026
- 2026Persuaded, Not Informed: Incentive-Misaligned Witnesses Defeat In-Context Grounding23 Sep 2026
- 2026AutoGym: Blueprint-First Generation of Verifiable Agent Gyms18 Sep 2026
- 2026CreaMem: A Scene-Aware Memory Architecture for Personalized Agents8 Sep 2026
- 2026AgentSLABench: Evaluating and Benchmarking Agentic Systems Under Resource Constraints1 Aug 2026
- 2026Sigma-Mem: An Online Reliability Memory for LLM-based Multi-Agent Systems30 Jul 2026
- 2026FORCE-Bench: A Benchmark, Dataset, and Evaluation Harness for Agentic AI in Enterprise Finance11 Jul 2026
- 2026TRUSTMEM: Learning Trustworthy Memory Consolidation for LLM Agents with Long-Term Memory23 Jun 2026
- 2026ToolChain-CRC: Conformal Risk Control for Agentic AI Under Retrieval and Tool-Use Drift16 Jun 2026
- 2026Agentic Retrieval and Reinforcement Learned Equation Chains: A Controlled Generation Framework for Complex and Novel Physics Word Problems14 Jun 2026
- 2026Rosetta Memory: Adaptive Memory for Cross-LLM Agents5 Jun 2026
12 newest of 75 All 75 (JSON)
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
- 2022ST-MoE: Designing Stable and Transferable Sparse Expert Modelscited by 391
- 2021MoEfication: Transformer Feed-forward Layers are Mixtures of Expertscited by 149
- 2023Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policycited by 104
- 2023Pre-gated MoE: An Algorithm-System Co-Design for Fast and Scalable Mixture-of-Expert Inferencecited by 101
- 2023To Repeat or Not To Repeat: Insights from Scaling LLM under Token-Crisiscited by 88
- 2023Soft Merging of Experts with Adaptive Routingcited by 88
- 2022Task-Specific Expert Pruning for Sparse Mixture-of-Expertscited by 69
- 2021Go Wider Instead of Deepercited by 56
- 2022Sparsely Activated Mixture-of-Experts are Robust Multi-Task Learnerscited by 51
- 2024Efficient Expert Pruning for Sparse Mixture-of-Experts Language Models: Enhancing Performance and Reducing Inference Costscited by 51
- 2024A Survey on Inference Optimization Techniques for Mixture of Experts Modelscited by 46
12 most cited of 60 All 60 (JSON)
- 2026MoME: Mixture-of-Memory Embeddings for Context-Aware Sparse Lookup14 Sep 2026
- 2026RAPTOR: Role-Aware Private Training for Mixture-of-Experts4 Sep 2026
- 2026SMELT: Scaling Laws for Compute-Matched MoE Looped Transformers1 Sep 2026
- 2026HiVe: Beyond Static Prompts for Multitask Learning via Hierarchy-based Vertical Mixture-of-Experts30 Aug 2026
- 2026Mixture-of-Expert Blocks Contain Strong Hallucination Detection Signals18 Aug 2026
- 2026Share First, Route What Remains: A Unified Framework for Token-Adaptive MoE Computation11 Aug 2026
- 2026cMoLLM at Scale: Horizontal Scaling Laws for Mixture-of-LLMs6 Jun 2026
- 2026RotMoLE: Enhancing Mixture of Low-Rank Experts through Rotational Gating Mechanism25 May 2026
- 2026φ-Balancing for Mixture-of-Experts Training14 May 2026
- 2026EMO: Pretraining Mixture of Experts for Emergent Modularity7 May 2026
- 2026Expert Pyramid Tuning: Efficient Parameter Fine-Tuning for Expertise-Driven Task Allocation13 Mar 2026
- 2026FlexMoRE: A Flexible Mixture of Rank-heterogeneous Experts for Efficient Federatedly-trained Large Language Models9 Feb 2026
12 newest of 60 All 60 (JSON)
- 2022Confident Adaptive Language Modelingcited by 297
- 2021Learned Token Pruning for Transformerscited by 138
- 2023SparQ Attention: Bandwidth-Efficient LLM Inferencecited by 119
- 2022The Optimal BERT Surgeon: Scalable and Accurate Second-Order Pruning for Large Language Modelscited by 115
- 2021Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challengescited by 114
- 2025KVzip: Query-Agnostic KV Cache Compression with Context Reconstructioncited by 89
- 2023Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decodingcited by 80
- 2025Cartridges: Lightweight and general-purpose long context representations via self-studycited by 74
- 2024Prompt Compression for Large Language Models: A Surveycited by 65
- 2024500xCompressor: Generalized Prompt Compression for Large Language Modelscited by 45
- 2022Token Dropping for Efficient BERT Pretrainingcited by 42
- 2021TR-BERT: Dynamic Token Reduction for Accelerating BERT Inferencecited by 40
12 most cited of 58 All 58 (JSON)
- 2026PatchKV: Weight-Space Compensation of KV Cache30 Sep 2026
- 2026Compressing Long Context into Answer-Aligned Memory Embeddings for LLM Inference22 Sep 2026
- 2026MetaKV: Adaptive KV Cache Compression for Constrained LLM Inference7 Sep 2026
- 2026TSS: Target-Side Sparsification for Speculative Decoding in Domain-Specific Large Language Models15 Aug 2026
- 2026HijackKV: New Threat in Position-Independent KV Cache Reuse22 Jul 2026
- 2026PReM: Learning What to Preserve and When to Refresh for Context Compression15 Jul 2026
- 2026RouteBalance: Fused Model Routing and Load Balancing for Heterogeneous LLM Serving16 Jun 2026
- 2026Multi-SPIN: Multi-Access Speculative Inference for Cooperative Token Generation at the Edge3 Jun 2026
- 2026LongAttnComp: Cross-Family Context Compression for Long-Context Reasoning31 May 2026
- 2026Beyond Position Bias: Shifting Context Compression from Position-Driven to Semantic-Driven10 May 2026
- 2026Watt Counts: Energy-Aware Benchmark for Sustainable LLM Inference on Heterogeneous GPU Architectures10 Apr 2026
- 2026Stream2LLM: Overlap Context Streaming and Prefill for Reduced Time-to-First-Token (TTFT)29 Mar 2026
12 newest of 58 All 58 (JSON)
- 2023Detecting Language Model Attacks with Perplexitycited by 411
- 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defensecited by 401
- 2023Can AI-Generated Text be Reliably Detected?cited by 372
- 2024Defending Against Indirect Prompt Injection Attacks With Spotlightingcited by 233
- 2023In-Context Unlearning: Language Models as Few Shot Unlearnerscited by 214
- 2021Be Careful about Poisoned Word Embeddings: Exploring the Vulnerability of the Embedding Layers in NLP Modelscited by 96
- 2022FedPrompt: Communication-Efficient and Privacy Preserving Prompt Tuning in Federated Learningcited by 86
- 2021Hidden Backdoors in Human-Centric Language Modelscited by 83
- 2021BadPre: Task-agnostic Backdoor Attacks to Pre-trained NLP Foundation Modelscited by 76
- 2023Evaluating the Instruction-Following Robustness of Large Language Models to Prompt Injectioncited by 53
- 2022Fine-mixing: Mitigating Backdoors in Fine-tuned Language Modelscited by 50
- 2022Constrained Optimization with Dynamic Bound-scaling for Effective NLPBackdoor Defensecited by 44
12 most cited of 44 All 44 (JSON)
- 2026SingProbe Technical Report31 Aug 2026
- 2026BASIS: Breach-Aware Selective Prompt Injection Shielding with Prefill Attention Probes8 Aug 2026
- 2026Addressing Over-Refusal in LLMs with Competing Rewards30 Jun 2026
- 2026A Red Teaming Framework for Large Language Models: A Case Study on Faithfulness Evaluation24 Jun 2026
- 2026GAS-Leak-LLM: Genetic Algorithm-Based Suffix Optimization for Black-Box LLM Jailbreaking14 Jun 2026
- 2026Linear Ensembles Wash Away Watermarks: On the Fragility of Distributional Perturbations in LLMs28 May 2026
- 2026Red Teaming LLMs as Socio-Technical Practice: From Exploration and Data Creation to Evaluation10 Feb 2026
- 2025Detecting Prompt Injection Attacks Against Application Using Classifiers14 Dec 2025
- 2025When unlearning is free: leveraging low influence points to reduce computational costs4 Dec 2025
- 2025A Survey on Unlearning in Large Language Models29 Oct 2025
- 2025HarmMetric Eval: Benchmarking Metrics and Judges for LLM Harmfulness Assessment29 Sep 2025
- 2025Module-Aware Parameter-Efficient Machine Unlearning on Transformers24 Aug 2025
12 newest of 44 All 44 (JSON)
- 2021SimVLM: Simple Visual Language Model Pretraining with Weak Supervisioncited by 645
- 2024GME: Improving Universal Multimodal Retrieval by Multimodal LLMscited by 166
- 2024FlashRAG: A Modular Toolkit for Efficient Retrieval-Augmented Generation Researchcited by 165
- 2024MM-Embed: Universal Multimodal Retrieval with Multimodal LLMscited by 159
- 2023UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoningcited by 158
- 2024NVLM: Open Frontier-Class Multimodal LLMscited by 124
- 2022VL-CheckList: Evaluating Pre-trained Vision-Language Models with Objects, Attributes and Relationscited by 113
- 2024GUICourse: From General Vision Language Models to Versatile GUI Agentscited by 112
- 2023What You See is What You Read? Improving Text-Image Alignment Evaluationcited by 105
- 2024VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?cited by 98
- 2024ScreenAI: A Vision-Language Model for UI and Infographics Understandingcited by 97
- 2024DesignQA: A Multimodal Benchmark for Evaluating Large Language Models' Understanding of Engineering Documentationcited by 30
12 most cited of 39 All 39 (JSON)
- 2026Backdoor Learning in Language Models and Vision-Language Models8 Jun 2026
- 2026DV-SFT: Direct Vision Supervision for Fine-Grained Visual Understanding26 May 2026
- 2026EVA: Editing for Versatile Alignment against Jailbreaks14 May 2026
- 2026MMRareBench: A Rare-Disease Multimodal and Multi-Image Medical Benchmark12 Apr 2026
- 2026AQuA: Toward Strategic Response Generation for Ambiguous Visual Questions8 Mar 2026
- 2026When Tables Go Crazy: Evaluating Multimodal Models on French Financial Documents11 Feb 2026
- 2025AgriGPT-Omni: A Unified Speech-Vision-Text Framework for Multilingual Agricultural Intelligence11 Dec 2025
- 2025SurgMLLMBench: A Multimodal Large Language Model Benchmark Dataset for Surgical Scene Understanding26 Nov 2025
- 2025MedGEN-Bench: A Contextually Entangled Benchmark for Open-ended Multimodal Medical Generation17 Nov 2025
- 2025Text-VQA Aug: Pipelined Harnessing of Large Multimodal Models for Automated Synthesis3 Nov 2025
- 2025RzenEmbed: Towards Comprehensive Multimodal Retrieval31 Oct 2025
- 2025Vision Function Layer in Multimodal LLMs29 Sep 2025
12 newest of 39 All 39 (JSON)
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
- 2023Pretraining Language Models with Human Preferencescited by 245
- 2023The Capacity for Moral Self-Correction in Large Language Modelscited by 171
- 2024Self-Taught Evaluatorscited by 70
- 2023Safer-Instruct: Aligning Language Models with Automated Preference Datacited by 27
- 2024A Survey on the Honesty of Large Language Modelscited by 21
- 2024Towards a Unified View of Preference Learning for Large Language Models: A Surveycited by 17
- 2025In-Training Defenses against Emergent Misalignment in Language Modelscited by 14
- 2025SoLoPO: Unlocking Long-Context Capabilities in LLMs via Short-to-Long Preference Optimizationcited by 10
- 2023Fine-tuning Language Models with Generative Adversarial Reward Modellingcited by 8
- 2025Winning the Pruning Gamble: A Unified Approach to Joint Sample and Token Pruning for Efficient Supervised Fine-Tuningcited by 8
- 2024Would I Lie To You? Inference Time Alignment of Language Models using Direct Preference Headscited by 5
12 most cited of 23 All 23 (JSON)
- 2026PolyAlign: Conditional Human-Distribution Alignment11 Jun 2026
- 2026CroCo: Cross-Lingual Contrastive Preference Tuning on Self-Generations25 May 2026
- 2026Rendering Data Unlearnable by Exploiting LLM Alignment Mechanisms6 Jan 2026
- 2025HLPD: Aligning LLMs to Human Language Preference for Machine-Revised Text Detection10 Nov 2025
- 2025LM-mixup: Text Data Augmentation via Language Model based Mixup23 Oct 2025
- 2025MedTrust-RAG: Evidence Verification and Trust Alignment for Biomedical Question Answering16 Oct 2025
- 2025Winning the Pruning Gamble: A Unified Approach to Joint Sample and Token Pruning for Efficient Supervised Fine-Tuning28 Sep 2025
- 2025Towards Alignment-Centric Paradigm: A Survey of Instruction Tuning in Large Language Models24 Aug 2025
- 2025In-Training Defenses against Emergent Misalignment in Language Models8 Aug 2025
- 2025Shapley Uncertainty in Natural Language Generation29 Jul 2025
- 2025Aligned Textual Scoring Rules8 Jul 2025
- 2025SoLoPO: Unlocking Long-Context Capabilities in LLMs via Short-to-Long Preference Optimization16 May 2025
12 newest of 23 All 23 (JSON)
- 2023Simple synthetic data reduces sycophancy in large language modelscited by 174
- 2024Better Synthetic Data by Retrieving and Transforming Existing Datasetscited by 36
- 2021STraTA: Self-Training with Task Augmentation for Better Few-shot Learningcited by 33
- 2024Generative AI for Synthetic Data Generation: Methods, Challenges and the Futurecited by 31
- 2021B-PROP: Bootstrapped Pre-training with Representative Words Prediction for Ad-hoc Retrievalcited by 25
- 2021Revisiting Self-Training for Few-Shot Learning of Language Modelcited by 22
- 2024Regurgitative Training: The Value of Real Data in Training Large Language Modelscited by 15
- 2023Few-Shot Data Synthesis for Open Domain Multi-Hop Question Answeringcited by 9
- 2024Prompting-based Synthetic Data Generation for Few-Shot Question Answeringcited by 9
- 2026Task-Aware LLM Routing with Multi-Level Task-Profile-Guided Data Synthesis for Cold-Start Scenarioscited by 8
- 2021Cooperative Self-training of Machine Reading Comprehensioncited by 5
- 2025AQuilt: Weaving Logic and Self-Inspection into Low-Cost, High-Relevance Data Synthesis for Specialist LLMscited by 4
12 most cited of 20 All 20 (JSON)
- 2026Not All Explanations Simulate Equally: Comparing Verbalized Feature Attributions and Self-Generated Rationales31 May 2026
- 2026Task-Aware LLM Routing with Multi-Level Task-Profile-Guided Data Synthesis for Cold-Start Scenarios10 Apr 2026
- 2026Continually self-improving AI18 Mar 2026
- 2025Can we Evaluate RAGs with Synthetic Data?15 Aug 2025
- 2025AQuilt: Weaving Logic and Self-Inspection into Low-Cost, High-Relevance Data Synthesis for Specialist LLMs24 Jul 2025
- 2025Building Open-Retrieval Conversational Question Answering Systems by Generating Synthetic Data and Decontextualizing User Questions7 Jul 2025
- 2025On Synthesizing Data for Context Attribution in Question Answering21 Feb 2025
- 2024Generating Synthetic Datasets for Few-shot Prompt Tuning8 Oct 2024
- 2024Regurgitative Training: The Value of Real Data in Training Large Language Models3 Jul 2024
- 2024Prompting-based Synthetic Data Generation for Few-Shot Question Answering15 May 2024
- 2024Better Synthetic Data by Retrieving and Transforming Existing Datasets22 Apr 2024
- 2024Generative AI for Synthetic Data Generation: Methods, Challenges and the Future7 Mar 2024
12 newest of 20 All 20 (JSON)
- 2023TESS: Text-to-Text Self-Conditioned Simplex Diffusioncited by 63
- 2024A Survey on Data Augmentation in Large Model Eracited by 31
- 2025TESS 2: A Large-Scale Generalist Diffusion Language Modelcited by 30
- 2023Diffusion-NAT: Self-Prompting Discrete Diffusion for Non-Autoregressive Text Generationcited by 21
- 2024Proof of Quality: A Costless Paradigm for Trustless Generative AI Model Inference on Blockchainscited by 7
- 2023InfoDiffusion: Information Entropy Aware Diffusion Process for Non-Autoregressive Text Generationcited by 5
- 2024Transfer Learning for Text Diffusion Modelscited by 5
- 2026AURORA-LM: Autoencoding Unified Representation for Continuous-Latent Diffusion Language Modelingcited by 3
- 2026Towards Faster Language Model Inference Using Mixture-of-Experts Flow Matchingcited by 0
- 2026AURORA-LM: Autoencoding Unified Representation for Continuous-Latent Diffusion Language Modeling3 Aug 2026
- 2026Towards Faster Language Model Inference Using Mixture-of-Experts Flow Matching16 Apr 2026
- 2025TESS 2: A Large-Scale Generalist Diffusion Language Model19 Feb 2025
- 2024Proof of Quality: A Costless Paradigm for Trustless Generative AI Model Inference on Blockchains28 May 2024
- 2024Transfer Learning for Text Diffusion Models30 Jan 2024
- 2024A Survey on Data Augmentation in Large Model Era27 Jan 2024
- 2023InfoDiffusion: Information Entropy Aware Diffusion Process for Non-Autoregressive Text Generation18 Oct 2023
- 2023TESS: Text-to-Text Self-Conditioned Simplex Diffusion15 May 2023
- 2023Diffusion-NAT: Self-Prompting Discrete Diffusion for Non-Autoregressive Text Generation6 May 2023
- 2020MOPO: Model-based Offline Policy Optimizationcited by 630
- 2022Behavior Transformers: Cloning k modes with one stonecited by 299
- 2020Text Generation by Learning from Demonstrationscited by 64
- 2021RLDS: an Ecosystem to Generate, Share and Use Datasets in Reinforcement Learningcited by 31
- 2025Reliable and Scalable Robot Policy Evaluation with Imperfect Simulatorscited by 13
- 2023Semi-Offline Reinforcement Learning for Optimized Text Generationcited by 12
- 2022S2P: State-conditioned Image Synthesis for Data Augmentation in Offline Reinforcement Learningcited by 9
- 2024Compositional Conservatism: A Transductive Approach in Offline Reinforcement Learningcited by 2
- 2024Unveiling Imitation Learning: Exploring the Impact of Data Falsity to Large Language Modelcited by 1
- 2025Reliable and Scalable Robot Policy Evaluation with Imperfect Simulators5 Oct 2025
- 2024Unveiling Imitation Learning: Exploring the Impact of Data Falsity to Large Language Model15 Apr 2024
- 2024Compositional Conservatism: A Transductive Approach in Offline Reinforcement Learning6 Apr 2024
- 2023Semi-Offline Reinforcement Learning for Optimized Text Generation16 Jun 2023
- 2022S2P: State-conditioned Image Synthesis for Data Augmentation in Offline Reinforcement Learning30 Sep 2022
- 2022Behavior Transformers: Cloning k modes with one stone22 Jun 2022
- 2021RLDS: an Ecosystem to Generate, Share and Use Datasets in Reinforcement Learning4 Nov 2021
- 2020Text Generation by Learning from Demonstrations16 Sep 2020
- 2020MOPO: Model-based Offline Policy Optimization27 May 2020
- 2024Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modelingcited by 167
- 2025Hybrid Architectures for Language Models: Systematic Analysis and Design Insightscited by 13
- 2026Interpreting and Steering State-Space Models via Activation Subspace Bottleneckscited by 3
- 2024Joint Fine-tuning and Conversion of Pretrained Speech and Language Models towards Linear Complexitycited by 1
- 2026Interpreting and Steering State-Space Models via Activation Subspace Bottlenecks26 Feb 2026
- 2025Hybrid Architectures for Language Models: Systematic Analysis and Design Insights6 Oct 2025
- 2024Joint Fine-tuning and Conversion of Pretrained Speech and Language Models towards Linear Complexity9 Oct 2024
- 2024Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling11 Jun 2024
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2023A Survey of Large Language Modelscited by 2,537
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,838
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,234
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2022Editing Models with Task Arithmeticcited by 1,076
12 most cited of 3,393 All 3,393 (JSON)
- 2026TACO: Ternary Absolute-max Column-wise One-sparse Optimizer for LLM Fine-Tuning1 Oct 2026
- 2026Fusing Visual and Textual Representations via Multi-layer Fusing Transformers for Vietnamese Visual Question Answering1 Oct 2026
- 2026Which LLM to pick? Online Active Model Selection for Large Language Models1 Oct 2026
- 2026Efficient Task Adaptation in Large Language Models: A Survey of Weight-Based, Prompt-Based, and Embedding-Based Adaptations1 Oct 2026
- 2026What Should an Agent Remember? Disentangling Retention from Retrieval in Bounded-Memory Evaluation30 Sep 2026
- 2026Inference Auctions30 Sep 2026
- 2026HO-FL: Hybrid-Order Federated Learning for Heterogeneous Edge Devices30 Sep 2026
- 2026Pretraining Latent Information Feedback Transformers with Teacher Supervision29 Sep 2026
- 2026Beyond Sub-Gaussian Detector Scores: Robust Weighted Profile-Loss Change Point Detection for Human-LLM Text Segmentation29 Sep 2026
- 2026QuantMLA: Function-Aligned Dual-Path Quantization for Low-Bit MLA KV Caching29 Sep 2026
- 2026BaRe-Mem: Bayesian Reliability Memory for Robust and Adaptive Agent Consultation28 Sep 2026
- 2026Spontaneous Context Restoration: How Language Models Recover from Corrupted Inputs28 Sep 2026
12 newest of 3,393 All 3,393 (JSON)