BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions
Not on the map. Why?
Cited by 176 in Mixture-of-experts, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
In this paper we study yes/no questions that are naturally occurring --- meaning that they are generated in unprompted and unconstrained settings. We build a reading comprehension dataset, BoolQ, of such questions, and show that they are unexpectedly challenging. They often query for complex, non-factoid information, and require difficult entailment-like inference to solve. We also explore the effectiveness of a range of transfer learning baselines. We find that transferring from entailment data is more effective than transferring from paraphrase or extractive QA data, and that it, surprisingly, continues to be very beneficial even when starting from massive pre-trained language models such as BERT. Our best method trains BERT on MultiNLI and then re-trains it on our train set. It achieves 80.4% accuracy compared to 90% accuracy of human annotators (and 62% majority-baseline), leaving a significant gap for future work.
Key facts. Cited by 2,140 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 86; 2022: 88; 2023: 239; 2024: 542; 2025: 633; 2026: 552.
2,140 papers.
Sort:
By area:
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2023Qwen Technical Reportcited by 3,273
- 2023Mistral 7Bcited by 3,065
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2023A Survey of Large Language Modelscited by 2,537
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
38 more
- 2024Mixtral of Expertscited by 1,785
- 2025Gemma 3 Technical Reportcited by 1,686
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
- 2023BloombergGPT: A Large Language Model for Financecited by 923
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
- 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 890
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 889
- 2023RWKV: Reinventing RNNs for the Transformer Eracited by 814
- 2023A Simple and Effective Pruning Approach for Large Language Modelscited by 776
- 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 755
- 2021Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategiescited by 736
- 2022Galactica: A Large Language Model for Sciencecited by 736
- 2023The Flan Collection: Designing Data and Methods for Effective Instruction Tuningcited by 734
- 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 733
- 2021GPT Understands, Toocited by 715
- 2024Yi: Open Foundation Models by 01.AIcited by 706
- 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 701
- 2023LLM-Pruner: On the Structural Pruning of Large Language Modelscited by 643
- 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 641
- 2023A Comprehensive Overview of Large Language Modelscited by 639
- 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 622
- 2023Instruction Tuning for Large Language Models: A Surveycited by 617
- 2024TinyLlama: An Open-Source Small Language Modelcited by 604
- 2024OLMo: Accelerating the Science of Language Modelscited by 599
- 2023Retentive Network: A Successor to Transformer for Large Language Modelscited by 594
- 2023Textbooks Are All You Need II: phi-1.5 technical reportcited by 559
- 2022Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Modelcited by 557
- 2023Language Is Not All You Need: Aligning Perception with Language Modelscited by 543
- 2023The Falcon Series of Open Language Modelscited by 526
- 2022ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformerscited by 517
- 2024Large Language Models: A Surveycited by 506
- 2023Gated Linear Attention Transformers with Hardware-Efficient Trainingcited by 490
- 2023Is ChatGPT a General-Purpose Natural Language Processing Task Solver?cited by 486
- 2024Gated Delta Networks: Improving Mamba2 with Delta Rulecited by 483
- 2021Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpuscited by 481
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
- 2021Compacter: Efficient Low-Rank Hypercomplex Adapter Layerscited by 458
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 457
50 most cited of 2,140 All 2,140 (JSON)
- 2026DivMoE: Fine-Grained MoE Upcycling via Cross-Domain Expert Composition8 Oct 2026
- 2026Few Bits, One Law: Toward W2A4KV26 Oct 2026
- 2026TACO: Ternary Absolute-max Column-wise One-sparse Optimizer for LLM Fine-Tuning1 Oct 2026
- 2026LLM-as-Jev: LLMs Are Already Jev-Style Decision Models -- When and How to Fine-Tune Them1 Oct 2026
- 2026Learn the Directions, Normalize the Gains: Post-Training Normalization for LoRA1 Oct 2026
- 2026TopK-Guided: Adaptive, Budget-Aware Activation Sparsity for Efficient LLM Inference1 Oct 2026
- 2026AURAL: Adaptive Latent Reasoning with Joint Chunk for Speech Language Models1 Oct 2026
- 2026The Devil Is in the Reconstruction Loss Scale: Rethinking Optimization in LLM Quantization1 Oct 2026
- 2026Backdoor Purification for LoRA-Tuned LLMs via Null-Space Projection30 Sep 2026
- 2026Backdoor Containment via Expert Quarantine and Shutdown in LLMs30 Sep 2026
- 2026Score the Update, Not the Token: Descent-Aligned Routing for Combinatorial LoRA Experts30 Sep 2026
- 2026AIR-LLM: Broadcasting AI Weights over Radio for Memory-Free Edge LLM Inference via RF Computing30 Sep 2026
38 more
- 2026MoRA: MoE Pruning via Router Bias Learning and Expert Approximation30 Sep 2026
- 2026Scaling Laws for Looped Mixture of Experts30 Sep 2026
- 2026SEPAL: Separated Expert Pairs with Answer-Level Fusion for Reliable LLM Collaboration30 Sep 2026
- 2026The Row Normalization Puzzle in Muon30 Sep 2026
- 2026Bongard: Training Machine Intuition30 Sep 2026
- 2026HO-FL: Hybrid-Order Federated Learning for Heterogeneous Edge Devices30 Sep 2026
- 2026Scaling Parameter and Context in Attention: Native Sparse Attention from Mixture-of-Head30 Sep 2026
- 2026Diversity Combining for Multi-Path LLM Reasoning30 Sep 2026
- 2026JARQ: Joint Alternating Refinement for Quantization29 Sep 2026
- 2026Pretraining Latent Information Feedback Transformers with Teacher Supervision29 Sep 2026
- 2026Evaluating and Benchmarking the System One Model Jev29 Sep 2026
- 2026CALIBUDGET: Calibration-Guided Source Allocation for Fixed-Budget Mixed-Reasoning Adaptation29 Sep 2026
- 2026From Checkpoint Variation to Selection Gains in Supervised Fine-Tuning29 Sep 2026
- 2026Triadic Linear Attention: Three-Dimensional Recurrent States for Long-Context Sequence Modeling29 Sep 2026
- 2026Fractional State Space Transition for Long Sequence Modeling28 Sep 2026
- 2026BASE: Batch-Aware Selection of Experts Using Predicted Removal Error for Efficient MoE Decoding28 Sep 2026
- 2026ThinQuant: Scalable Rotation Learning for Weight and Activation Quantization of LLMs28 Sep 2026
- 2026IMC-CLINIC: Coupled Loss-Informed Newton Iterations for Clipping in Analog In-Memory Computing28 Sep 2026
- 2026FactorEngram: Factorized N-gram Memory with Basis-Level Gating for Language Models28 Sep 2026
- 2026QAM: Quadratic-Accurate Checkpoint Merging via Sequential Consistency28 Sep 2026
- 2026EdgeCraft: Automated Model Crafting for Edge IoT28 Sep 2026
- 2026When Can Attention Heads Be Statically Defined?28 Sep 2026
- 2026X-MoD: Practical Scaling Laws for Sparse-Depth Routing Beyond Mixture-of-Depths28 Sep 2026
- 2026GradLev: Token-Parallel Test-Time Training Via Costate Prediction28 Sep 2026
- 2026GroupMask: Layer-Adaptive Group-wise Sparsity for Semi-Structured LLM Pruning27 Sep 2026
- 2026JET: Justification Evaluation in Transformer27 Sep 2026
- 2026Dual-Vocabulary Language Model for Cross-Tokenizer Distillation27 Sep 2026
- 2026EAT: Expert Account Tracker for Efficient MoE Inference27 Sep 2026
- 2026TerMeZO: Ternary Sparse Zeroth-Order Optimization for Fine-tuning BitNet Models at the Edge27 Sep 2026
- 2026CFLoRA: Federated Fine-tuning of LLMs with Complementary Factors for Error-free Aggregation27 Sep 2026
- 2026Routing Drift Alone Does Not Diagnose Failure in Merged MoE LLMs26 Sep 2026
- 2026SoFT: Soft Targets for Generalizable LLM Fine-Tuning26 Sep 2026
- 2026Model Casting and Low-Parameter Gating: Towards More Sparsely Activated FFNs25 Sep 2026
- 2026Block Sparse Attention with Log-Linear Complexity25 Sep 2026
- 2026LAVOIR: Teaching a Single-Pass Decision Encoder When and What to Ask with Amortized Value of Information25 Sep 2026
- 2026Automatic Rank Allocation for Low-Rank Adaptation in Large Language Models via lp Regularization24 Sep 2026
- 2026From Static Personal Values to Contextualized Personalization: Bayesian Personalized Value Alignment for LLMs24 Sep 2026
- 2026When Should LLMs Trust Their Own Revisions? A Risk-Aware Study of Intrinsic Self-Correction23 Sep 2026
50 newest of 2,140 All 2,140 (JSON)
- 2024Mixtral of Expertscited by 1,785
- 2024Jamba: A Hybrid Transformer-Mamba Language Modelcited by 390
- 2024OLMoE: Open Mixture-of-Experts Language Modelscited by 291
- 2021Efficient Large Scale Language Modeling with Mixtures of Expertscited by 175
- 2024MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of Expertscited by 144
- 2023Mixture-of-Experts Meets Instruction Tuning:A Winning Combination for Large Language Modelscited by 65
- 2024MoMa: Efficient Early-Fusion Pre-training with Mixture of Modality-Aware Expertscited by 61
- 2024MoE-Pruner: Pruning Mixture-of-Experts Large Language Model using the Hints from Its Routercited by 58
- 2024MoE-I2: Compressing Mixture of Experts Models through Inter-Expert Pruning and Intra-Expert Low-Rank Decompositioncited by 57
- 2024JetMoE: Reaching Llama2 Performance with 0.1M Dollarscited by 55
- 2024MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Expertscited by 55
- 2024MoELoRA: Contrastive Learning Guided Mixture of Experts on Parameter-Efficient Fine-Tuning for Large Language Modelscited by 54
12 most cited of 173 All 173 (JSON)
- 2026Score the Update, Not the Token: Descent-Aligned Routing for Combinatorial LoRA Experts30 Sep 2026
- 2026MoRA: MoE Pruning via Router Bias Learning and Expert Approximation30 Sep 2026
- 2026Scaling Laws for Looped Mixture of Experts30 Sep 2026
- 2026BASE: Batch-Aware Selection of Experts Using Predicted Removal Error for Efficient MoE Decoding28 Sep 2026
- 2026X-MoD: Practical Scaling Laws for Sparse-Depth Routing Beyond Mixture-of-Depths28 Sep 2026
- 2026EAT: Expert Account Tracker for Efficient MoE Inference27 Sep 2026
- 2026Routing Drift Alone Does Not Diagnose Failure in Merged MoE LLMs26 Sep 2026
- 2026You Only Need 2/3 of the Chosen Experts: An Empirical Study of Dynamic Expert Pruning in Fine-Grained MoE LLMs22 Sep 2026
- 2026Colla-Q: Toward Collaborative Experts in MoE Quantization via Minimax Precision Balancing16 Sep 2026
- 2026MoME: Mixture-of-Memory Embeddings for Context-Aware Sparse Lookup14 Sep 2026
- 2026Data Scarcity and Model Sparsity: Mixtures-of-Experts Overfit More to Repeated Data10 Sep 2026
- 2026OMP-MoE: Efficient Expert Pruning for Mixture-of-Experts LLMs via Orthogonal Matching Pursuit9 Sep 2026
12 newest of 173 All 173 (JSON)
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2024Titans: Learning to Memorize at Test Timecited by 303
- 2024The Unreasonable Ineffectiveness of the Deeper Layerscited by 219
- 2023Shepherd: A Critic for Language Model Generationcited by 96
- 2023Batch Calibration: Rethinking Calibration for In-Context Learning and Prompt Engineeringcited by 91
- 2024Functional Benchmarks for Robust Evaluation of Reasoning Performance, and the Reasoning Gapcited by 79
- 2023Boosting Language Models Reasoning with Chain-of-Knowledge Promptingcited by 77
- 2023Contrastive Decoding Improves Reasoning in Large Language Modelscited by 71
- 2023Corex: Pushing the Boundaries of Complex Reasoning through Multi-Model Collaborationcited by 70
- 2024Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Modelscited by 60
12 most cited of 93 All 93 (JSON)
- 2026AURAL: Adaptive Latent Reasoning with Joint Chunk for Speech Language Models1 Oct 2026
- 2026The Devil Is in the Reconstruction Loss Scale: Rethinking Optimization in LLM Quantization1 Oct 2026
- 2026Diversity Combining for Multi-Path LLM Reasoning30 Sep 2026
- 2026Reasoning-Preserving Fine-Tuning of Post-RL LLMs with Null-Basis LoRA22 Sep 2026
- 2026State of Thought Enables Endogenous Reasoning13 Sep 2026
- 2026Text Capability Loss in Vision-Language Adaptation: An Attention-Sink Diagnosis1 Sep 2026
- 2026You Only Pass Once: Answering and Abstaining Together in a Single Forward Pass of a Frozen Language Model14 Aug 2026
- 2026CHASE: Cache-Hole-Adapted Skip Exit for Looped State-Space Language Models11 Jul 2026
- 2026Can We Trust LLM's Logic? Quantifying Uncertainty, Coherence, and Robustness via a Graph-Based Framework9 Jul 2026
- 2026Bayesian Sparse Low-Rank Adaptation for Large Language Model Uncertainty Estimation2 Jul 2026
- 2026Learning to Select, Not Relearn: Hard-Routed Mixtures of Reasoning LoRAs30 Jun 2026
- 2026Confidence Composition for Multiagent Language Model Systems11 Jun 2026
12 newest of 93 All 93 (JSON)
- 2024SpinQuant: LLM quantization with learned rotationscited by 446
- 2024LayerSkip: Enabling Early Exit Inference and Self-Speculative Decodingcited by 302
- 2023Atom: Low-bit Quantization for Efficient and Accurate LLM Servingcited by 255
- 2024Long Context Compression with Activation Beaconcited by 101
- 2024Get More with LESS: Synthesizing Recurrence with KV Cache Compression for Efficient LLM Inferencecited by 75
- 2023EE-LLM: Large-Scale Training and Inference of Early-Exit Large Language Models with 3D Parallelismcited by 69
- 2024Layer-Condensed KV Cache for Efficient Inference of Large Language Modelscited by 58
- 2024LoRC: Low-Rank Compression for LLMs KV Cache with a Progressive Compression Strategycited by 50
- 2024ProSparse: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Modelscited by 43
- 2024Effectively Compress KV Heads for LLMcited by 30
- 2024Generation Meets Verification: Accelerating Large Language Model Inference with Smart Parallel Auto-Correct Decodingcited by 22
- 2024ABQ-LLM: Arbitrary-Bit Quantized Inference Acceleration for Large Language Modelscited by 22
12 most cited of 56 All 56 (JSON)
- 2026Few Bits, One Law: Toward W2A4KV26 Oct 2026
- 2026TopK-Guided: Adaptive, Budget-Aware Activation Sparsity for Efficient LLM Inference1 Oct 2026
- 2026FlexEE: Self-Speculative and KV-Compatible Early Exiting for Offloading-Aware LLM Inference15 Sep 2026
- 2026Sparse Token Routing in Efficient Transformers21 Aug 2026
- 2026GyRot: Leveraging Hidden Synergy between Rotation and Fine-grained Group Quantization for Low-bit LLM Inference30 Jul 2026
- 2026MXSens: Sensitivity-Aware Mixed-Precision Quantization for Efficient LLM Inference20 Jul 2026
- 2026Quantize the Target, Quantize the Drafter: Efficient Inference with Qwen3.5-4B5 Jul 2026
- 2026On the Expressive Power of Weight Quantization in Large Language Models20 Jun 2026
- 2026Keyless Attention: Value-Space Routing and Value-Only Caching for Efficient Transformers20 Jun 2026
- 2026Taylor-Calibrate: Principled Initialization for Hybrid Linear Attention Distillation15 Jun 2026
- 2026Efficient On-Device Diffusion LLM Inference with Mobile NPU11 Jun 2026
- 2026UniSVQ: 2-bit Unified Scalar-Vector Quantization9 Jun 2026
12 newest of 56 All 56 (JSON)
- 2023Detecting Language Model Attacks with Perplexitycited by 411
- 2023Who's Harry Potter? Approximate Unlearning in LLMscited by 366
- 2024Large Language Model Unlearning via Embedding-Corrupted Promptscited by 112
- 2024SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearningcited by 104
- 2024The Butterfly Effect of Altering Prompts: How Small Changes and Jailbreaks Affect Large Language Model Performancecited by 97
- 2023Red teaming ChatGPT via Jailbreaking: Bias, Robustness, Reliability and Toxicitycited by 86
- 2024Reversing the Forget-Retain Objectives: An Efficient LLM Unlearning Framework from Logit Differencecited by 85
- 2023Attack Prompt Generation for Red Teaming and Defending Large Language Modelscited by 73
- 2024LLM Unlearning via Loss Adjustment with Only Forget Datacited by 71
- 2024On the Role of Attention Heads in Large Language Model Safetycited by 70
- 2024Eraser: Jailbreaking Defense in Large Language Models via Unlearning Harmful Knowledgecited by 48
- 2023NOTABLE: Transferable Backdoor Attacks Against Prompt-based NLP Modelscited by 33
12 most cited of 42 All 42 (JSON)
- 2026Backdoor Purification for LoRA-Tuned LLMs via Null-Space Projection30 Sep 2026
- 2026Backdoor Containment via Expert Quarantine and Shutdown in LLMs30 Sep 2026
- 2026OpenStamp: A Watermark for Open-Source Language Models28 Aug 2026
- 2026Probe-Geometry Alignment: Erasing the Cross-Sequence Memorization Signature Below Chance3 May 2026
- 2026Purifying Generative LLMs from Backdoors without Prior Knowledge or Clean Reference13 Mar 2026
- 2026AISA: Awakening Intrinsic Safety Awareness in Large Language Models against Jailbreak Attacks14 Feb 2026
- 2026Do Prompts Guarantee Safety? Mitigating Toxicity from LLM Generations through Subspace Intervention6 Feb 2026
- 2026Representation-Aware Unlearning via Activation Signatures: From Suppression to Entity-Signature Erasure15 Jan 2026
- 2026ForgetMark: Stealthy Fingerprint Embedding via Targeted Unlearning in Language Models13 Jan 2026
- 2025Safety-Preserving PTQ via Contrastive Alignment Loss11 Nov 2025
- 2025Label Smoothing Improves Gradient Ascent in LLM Unlearning25 Oct 2025
- 2025PIShield: Detecting Prompt Injection Attacks via Intrinsic LLM Features15 Oct 2025
12 newest of 42 All 42 (JSON)
- 2023Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervisioncited by 445
- 2023UltraFeedback: Boosting Language Models with Scaled AI Feedbackcited by 394
- 2023Shadow Alignment: The Ease of Subverting Safely-Aligned Language Modelscited by 284
- 2024Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modificationscited by 220
- 2023TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Modelscited by 59
- 2024Learn Your Reference Model for Real Good Alignmentcited by 56
- 2024Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignmentcited by 46
- 2024Insights into Alignment: Evaluating DPO and its Variants Across Multiple Taskscited by 35
- 2024Model Editing as a Robust and Denoised variant of DPO: A Case Study on Toxicitycited by 33
- 2023Safer-Instruct: Aligning Language Models with Automated Preference Datacited by 27
- 2024Weak-to-Strong Generalization Through the Data-Centric Lenscited by 21
- 2024Do as I do (Safely): Mitigating Task-Specific Fine-tuning Risks in Large Language Modelscited by 17
12 most cited of 38 All 38 (JSON)
- 2026Forty Shades of Blue: Quality-Diversity Alignment via Mode-Conditioned Reinforcement Learning14 Sep 2026
- 2026When Safety Routing Breaks: Understanding Alignment Fragility under Benign Fine-Tuning1 Sep 2026
- 2026SafeGene: Reusable Adapters for Transferable Safety Alignment2 Jun 2026
- 2026Position: Retire the "Positive Backdoor" Label -- Secret Alignment Requires Strict and Systematic Evaluation27 May 2026
- 2026The Art of (Mis)alignment: How Fine-Tuning Methods Effectively Misalign and Realign LLMs in Post-Training9 Apr 2026
- 2026Random Is Hard to Beat: Active Selection in online DPO with Modern LLMs3 Apr 2026
- 2026When Do LLM Preferences Predict Downstream Behavior?21 Feb 2026
- 2026Fail-Closed Alignment for Large Language Models19 Feb 2026
- 2026Know When You're Wrong: Aligning Confidence with Correctness for LLM Error Detection18 Feb 2026
- 2025Interpretable Safety Alignment via SAE-Constructed Low-Rank Subspace Adaptation29 Dec 2025
- 2025Detoxifying Large Language Models via Autoregressive Reward Guided Representation Editing24 Sep 2025
- 2025Turning the Spell Around: Lightweight Alignment Amplification via Rank-One Safety Injection28 Aug 2025
12 newest of 38 All 38 (JSON)
- 2023DreamLLM: Synergistic Multimodal Comprehension and Creationcited by 296
- 2024FlashRAG: A Modular Toolkit for Efficient Retrieval-Augmented Generation Researchcited by 165
- 2023MobileVLM : A Fast, Strong and Open Vision Language Assistant for Mobile Devicescited by 120
- 2024LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via a Hybrid Architecturecited by 100
- 2023Fool Your (Vision and) Language Model With Embarrassingly Simple Permutationscited by 24
- 2024SPORTU: A Comprehensive Sports Understanding Benchmark for Multimodal Large Language Modelscited by 24
- 2025Eve: Efficient Multimodal Vision Language Models with Elastic Visual Expertscited by 11
- 2025Large (Vision) Language Models are Unsupervised In-Context Learnerscited by 6
- 2025MoE-Inference-Bench: Performance Evaluation of Mixture of Expert Large Language and Vision Modelscited by 6
- 2024MLAN: Language-Based Instruction Tuning Preserves and Transfers Knowledge in Multimodal Language Modelscited by 5
- 2025Hierarchical Safety Realignment: Lightweight Restoration of Safety in Pruned Large Vision-Language Modelscited by 4
- 2025Activation-Informed Pareto-Guided Low-Rank Compression for Efficient LLM/VLMcited by 3
12 most cited of 22 All 22 (JSON)
- 2026Bayesian Adaptation Gym: A Benchmark for the Bayesian Low-Rank Adaptation of Multi-Modal Language Models20 Jun 2026
- 2026EVA: Editing for Versatile Alignment against Jailbreaks14 May 2026
- 2026From Images to Words: Efficient Cross-Modal Knowledge Distillation to Language Models from Black-box Teachers11 Mar 2026
- 2026Can Unified Generation and Understanding Models Maintain Semantic Equivalence Across Different Output Modalities?27 Feb 2026
- 2026Grounded Concreteness: Human-Like Concreteness Sensitivity in Vision-Language Models26 Jan 2026
- 2025Seeing is Believing? Evaluating Vision-Language Model Susceptibility in Agent-to-Agent Multimodal Persuasion26 Oct 2025
- 2025Activation-Informed Pareto-Guided Low-Rank Compression for Efficient LLM/VLM7 Oct 2025
- 2025MoE-Inference-Bench: Performance Evaluation of Mixture of Expert Large Language and Vision Models24 Aug 2025
- 2025Zero-Shot Vision Encoder Grafting via LLM Surrogates28 May 2025
- 2025DeCAF: Decentralized Consensus-And-Factorization for Low-Rank Adaptation of Foundation Models27 May 2025
- 2025Hierarchical Safety Realignment: Lightweight Restoration of Safety in Pruned Large Vision-Language Models22 May 2025
- 2025Resampling Benchmark for Efficient Comprehensive Evaluation of Large Vision-Language Models14 Apr 2025
12 newest of 22 All 22 (JSON)
- 2024Scaling up Masked Diffusion Models on Textcited by 195
- 2025Generalized Interpolating Discrete Diffusioncited by 68
- 2025Diffusion Beats Autoregressive in Data-Constrained Settingscited by 61
- 2024Mixture-of-Subspaces in Low-Rank Adaptationcited by 47
- 2025Scaling Behavior of Discrete Diffusion Language Modelscited by 32
- 2026Scaling Beyond Masked Diffusion Language Modelscited by 22
- 2025Next Semantic Scale Prediction via Hierarchical Diffusion Language Modelscited by 7
- 2025Non-Markovian Discrete Diffusion with Causal Language Modelscited by 5
- 2025Simple Denoising Diffusion Language Modelscited by 2
- 2026LoSA: Locality Aware Sparse Attention for Block-Wise Diffusion Language Modelscited by 2
- 2026Generalized Discrete Diffusion with Self-Correctioncited by 1
- 2026Layer Collapse in Diffusion Language Modelscited by 1
12 most cited of 17 All 17 (JSON)
- 2026How to Guide Your Language Flow16 Sep 2026
- 2026Training Hybrid Block Diffusion Language Models with Partial Bidirectionality2 Jul 2026
- 2026Bifocal Diffusion Language Models: Asymmetric Bidirectional Context for Parallel Generation26 Jun 2026
- 2026Looped Diffusion Language Models25 May 2026
- 2026Layer Collapse in Diffusion Language Models7 May 2026
- 2026LoSA: Locality Aware Sparse Attention for Block-Wise Diffusion Language Models13 Apr 2026
- 2026MDM-Prime-v2: Binary Encoding and Index Shuffling Enable Scaling of Diffusion Language Models17 Mar 2026
- 2026Scaling Beyond Masked Diffusion Language Models16 Feb 2026
- 2026Generalized Discrete Diffusion with Self-Correction13 Feb 2026
- 2025Scaling Behavior of Discrete Diffusion Language Models11 Dec 2025
- 2025Simple Denoising Diffusion Language Models27 Oct 2025
- 2025Next Semantic Scale Prediction via Hierarchical Diffusion Language Models8 Oct 2025
12 newest of 17 All 17 (JSON)
- 2025Lifelong Learning of Large Language Model based Agents: A Roadmapcited by 78
- 2024Benchmark Self-Evolving: A Multi-Agent Framework for Dynamic LLM Evaluationcited by 73
- 2024AMOR: A Recipe for Building Adaptable Modular Knowledge Agents Through Process Feedbackcited by 25
- 2024ACC-Collab: An Actor-Critic Approach to Multi-Agent LLM Collaborationcited by 22
- 2024WTU-EVAL: A Whether-or-Not Tool Usage Evaluation Benchmark for Large Language Modelscited by 12
- 2026Robust Multi-Agent LLMs under Byzantine Faultscited by 10
- 2024Enhancing Agent Learning through World Dynamics Modelingcited by 9
- 2025Tools in the Loop: Quantifying Uncertainty of LLM Question Answering Systems That Use Toolscited by 7
- 2026Multi-Agent Debate Strategies: Survey, Taxonomy, and Challengescited by 3
- 2025Model Editing as a Double-Edged Sword: Steering Agent Ethical Behavior Toward Beneficence or Harmcited by 2
- 2025GAMA: A General Anonymizing Multi-Agent System for Privacy Preservation Enhanced by Domain Rules and Disproof Mechanismcited by 2
- 2025On-Device Fine-Tuning via Backprop-Free Zeroth-Order Optimizationcited by 1
12 most cited of 16 All 16 (JSON)
- 2026SPT: Skills as Pre-Training Data for Agentic Language Models27 Aug 2026
- 2026Multi-Agent Debate Strategies: Survey, Taxonomy, and Challenges28 Jul 2026
- 2026Robust Multi-Agent LLMs under Byzantine Faults9 May 2026
- 2026SOLAR: A Self-Optimizing Open-Ended Autonomous Agent for Lifelong Learning and Continual Adaptation23 Mar 2026
- 2026ToolWeaver: Weaving Collaborative Semantics for Scalable Tool Use in Large Language Models29 Jan 2026
- 2025Single LLM Debate, MoLaCE: Mixture of Latent Concept Experts Against Confirmation Bias29 Dec 2025
- 2025On-Device Fine-Tuning via Backprop-Free Zeroth-Order Optimization14 Nov 2025
- 2025GAMA: A General Anonymizing Multi-Agent System for Privacy Preservation Enhanced by Domain Rules and Disproof Mechanism12 Sep 2025
- 2025Model Editing as a Double-Edged Sword: Steering Agent Ethical Behavior Toward Beneficence or Harm25 Jun 2025
- 2025Tools in the Loop: Quantifying Uncertainty of LLM Question Answering Systems That Use Tools22 May 2025
- 2025Lifelong Learning of Large Language Model based Agents: A Roadmap13 Jan 2025
- 2024ACC-Collab: An Actor-Critic Approach to Multi-Agent LLM Collaboration30 Oct 2024
12 newest of 16 All 16 (JSON)
- 2023RA-DIT: Retrieval-Augmented Dual Instruction Tuningcited by 194
- 2023Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Studycited by 63
- 2023A Multi-Task Embedder For Retrieval Augmented LLMscited by 63
- 2024SimRAG: Self-Improving Retrieval-Augmented Generation for Adapting Large Language Models to Specialized Domainscited by 28
- 2025SePer: Measure Retrieval Utility Through The Lens Of Semantic Perplexity Reductioncited by 24
- 2025Benchmarking Poisoning Attacks against Retrieval-Augmented Generationcited by 17
- 2025Rankify: A Comprehensive Python Toolkit for Retrieval, Re-Ranking, and Retrieval-Augmented Generationcited by 13
- 2025Who Taught the Lie? Responsibility Attribution for Poisoned Knowledge in Retrieval-Augmented Generationcited by 12
- 2024One Token Can Help! Learning Scalable and Pluggable Virtual Tokens for Retrieval-Augmented Large Language Modelscited by 4
- 2024ELOQ: Resources for Enhancing LLM Detection of Out-of-Scope Questionscited by 2
- 2024Enhancing Cluster Resilience: LLM-agent Based Autonomous Intelligent Cluster Diagnosis System and Evaluation Frameworkcited by 2
- 2025From Ambiguity to Accuracy: The Transformative Effect of Coreference Resolution on Retrieval-Augmented Generation systemscited by 0
12 most cited of 14 All 14 (JSON)
- 2026Training the Knowledge Base through Evidence Distillation and Write-Back Enrichment26 Mar 2026
- 2025Citation Failure: Definition, Analysis and Efficient Mitigation23 Oct 2025
- 2025Who Taught the Lie? Responsibility Attribution for Poisoned Knowledge in Retrieval-Augmented Generation17 Sep 2025
- 2025From Ambiguity to Accuracy: The Transformative Effect of Coreference Resolution on Retrieval-Augmented Generation systems10 Jul 2025
- 2025Benchmarking Poisoning Attacks against Retrieval-Augmented Generation24 May 2025
- 2025SePer: Measure Retrieval Utility Through The Lens Of Semantic Perplexity Reduction3 Mar 2025
- 2025Rankify: A Comprehensive Python Toolkit for Retrieval, Re-Ranking, and Retrieval-Augmented Generation4 Feb 2025
- 2024Enhancing Cluster Resilience: LLM-agent Based Autonomous Intelligent Cluster Diagnosis System and Evaluation Framework8 Nov 2024
- 2024SimRAG: Self-Improving Retrieval-Augmented Generation for Adapting Large Language Models to Specialized Domains23 Oct 2024
- 2024ELOQ: Resources for Enhancing LLM Detection of Out-of-Scope Questions18 Oct 2024
- 2024One Token Can Help! Learning Scalable and Pluggable Virtual Tokens for Retrieval-Augmented Large Language Models30 May 2024
- 2023A Multi-Task Embedder For Retrieval Augmented LLMs11 Oct 2023
12 newest of 14 All 14 (JSON)
- 2024On the Diversity of Synthetic Data and its Impact on Training Large Language Modelscited by 56
- 2024DataGen: Unified Synthetic Dataset Generation via Large Language Modelscited by 22
- 2025BeyondWeb: Lessons from Scaling Synthetic Data for Trillion-scale Pretrainingcited by 19
- 2021Self-training with Few-shot Rationalization: Teacher Explanations Aid Student in Few-shot NLUcited by 13
- 2026Self-Improving Pretraining: using post-trained models to pretrain better modelscited by 6
- 2025Learning to Plan Before Answering: Self-Teaching LLMs to Learn Abstract Plans for Problem Solvingcited by 4
- 2023Synthetic Data Generation in Low-Resource Settings via Fine-Tuning of Large Language Modelscited by 3
- 2024SoftSRV: Learn to Generate Targeted Synthetic Datacited by 3
- 2025Grounding Synthetic Data Evaluations of Language Models in Unsupervised Document Corporacited by 2
- 2023Mean BERTs make erratic language teachers: the effectiveness of latent bootstrapping in low-resource settingscited by 0
- 2026Recover-LoRA for Aggressive Quantization: Reclaiming Accuracy in 2-Bit Language Models via Low-Rank Adaptation with Knowledge Distillation on Synthetic Datacited by 0
- 2026Self-Improving is Often Sudden: Enlightenment-style Finetuning for Large-Scale Modelscited by 0
12 most cited of 13 All 13 (JSON)
- 2026Quantifying Error Tolerance in Synthetic Data: An Atomic-level Operand vs. Operator Perturbation Study29 Aug 2026
- 2026Self-Improving is Often Sudden: Enlightenment-style Finetuning for Large-Scale Models15 Jul 2026
- 2026Recover-LoRA for Aggressive Quantization: Reclaiming Accuracy in 2-Bit Language Models via Low-Rank Adaptation with Knowledge Distillation on Synthetic Data2 Jun 2026
- 2026Self-Improving Pretraining: using post-trained models to pretrain better models29 Jan 2026
- 2025BeyondWeb: Lessons from Scaling Synthetic Data for Trillion-scale Pretraining14 Aug 2025
- 2025Grounding Synthetic Data Evaluations of Language Models in Unsupervised Document Corpora13 May 2025
- 2025Learning to Plan Before Answering: Self-Teaching LLMs to Learn Abstract Plans for Problem Solving28 Apr 2025
- 2024SoftSRV: Learn to Generate Targeted Synthetic Data21 Oct 2024
- 2024On the Diversity of Synthetic Data and its Impact on Training Large Language Models19 Oct 2024
- 2024DataGen: Unified Synthetic Dataset Generation via Large Language Models27 Jun 2024
- 2023Mean BERTs make erratic language teachers: the effectiveness of latent bootstrapping in low-resource settings30 Oct 2023
- 2023Synthetic Data Generation in Low-Resource Settings via Fine-Tuning of Large Language Models2 Oct 2023
12 newest of 13 All 13 (JSON)
- 2023Gated Linear Attention Transformers with Hardware-Efficient Trainingcited by 490
- 2024Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modelingcited by 167
- 2024Longhorn: State Space Models are Amortized Online Learnerscited by 58
- 2026Gated DeltaNet-2: Decoupling Erase and Write in Linear Attentioncited by 24
- 2024Bi-Mamba: Towards Accurate 1-Bit State Space Modelscited by 10
- 2025TransMamba: A Sequence-Level Hybrid Transformer-Mamba Language Modelcited by 7
- 2024Taipan: Efficient and Expressive State Space Language Models with Selective Attentioncited by 4
- 2025SpikingMamba: Towards Energy-Efficient Large Language Models via Knowledge Distillation from Mambacited by 3
- 2025End-to-End Multi-Modal Diffusion Mambacited by 3
- 2026Attention to Mamba: A Recipe for Cross-Architecture Distillationcited by 3
- 2026Gated DeltaNet-2: Decoupling Erase and Write in Linear Attention21 May 2026
- 2026Attention to Mamba: A Recipe for Cross-Architecture Distillation1 Apr 2026
- 2025End-to-End Multi-Modal Diffusion Mamba15 Oct 2025
- 2025SpikingMamba: Towards Energy-Efficient Large Language Models via Knowledge Distillation from Mamba6 Oct 2025
- 2025TransMamba: A Sequence-Level Hybrid Transformer-Mamba Language Model31 Mar 2025
- 2024Bi-Mamba: Towards Accurate 1-Bit State Space Models18 Nov 2024
- 2024Taipan: Efficient and Expressive State Space Language Models with Selective Attention24 Oct 2024
- 2024Longhorn: State Space Models are Amortized Online Learners19 Jul 2024
- 2024Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling11 Jun 2024
- 2023Gated Linear Attention Transformers with Hardware-Efficient Training11 Dec 2023
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2023Qwen Technical Reportcited by 3,273
- 2023Mistral 7Bcited by 3,065
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2023A Survey of Large Language Modelscited by 2,537
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
- 2025Gemma 3 Technical Reportcited by 1,686
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
- 2023BloombergGPT: A Large Language Model for Financecited by 923
12 most cited of 1,641 All 1,641 (JSON)
- 2026DivMoE: Fine-Grained MoE Upcycling via Cross-Domain Expert Composition8 Oct 2026
- 2026TACO: Ternary Absolute-max Column-wise One-sparse Optimizer for LLM Fine-Tuning1 Oct 2026
- 2026LLM-as-Jev: LLMs Are Already Jev-Style Decision Models -- When and How to Fine-Tune Them1 Oct 2026
- 2026Learn the Directions, Normalize the Gains: Post-Training Normalization for LoRA1 Oct 2026
- 2026AIR-LLM: Broadcasting AI Weights over Radio for Memory-Free Edge LLM Inference via RF Computing30 Sep 2026
- 2026SEPAL: Separated Expert Pairs with Answer-Level Fusion for Reliable LLM Collaboration30 Sep 2026
- 2026The Row Normalization Puzzle in Muon30 Sep 2026
- 2026Bongard: Training Machine Intuition30 Sep 2026
- 2026HO-FL: Hybrid-Order Federated Learning for Heterogeneous Edge Devices30 Sep 2026
- 2026Scaling Parameter and Context in Attention: Native Sparse Attention from Mixture-of-Head30 Sep 2026
- 2026JARQ: Joint Alternating Refinement for Quantization29 Sep 2026
- 2026Pretraining Latent Information Feedback Transformers with Teacher Supervision29 Sep 2026
12 newest of 1,641 All 1,641 (JSON)