SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems

1. 2022Training language models to follow instructions with human feedbackcited by 15,712
2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
3. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
5. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
6. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
7. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
8. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
9. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
10. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
11. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
12. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674

50 most cited of 1,718 · All 1,718 (JSON)

1. 2026A Self-Pruning Transformer: Extreme KV-Cache Compression with Universal Attention6 Oct 2026
2. 2026TACO: Ternary Absolute-max Column-wise One-sparse Optimizer for LLM Fine-Tuning1 Oct 2026
3. 2026Task-Oriented Rank Adaptation for Continual Learning in Text Classification1 Oct 2026
4. 2026Which LLM to pick? Online Active Model Selection for Large Language Models1 Oct 2026
5. 2026Why Does Train-Validation Separation Emerge? Update-Pressure Density Dynamics in Pretrained Backbones1 Oct 2026
6. 2026Efficient Task Adaptation in Large Language Models: A Survey of Weight-Based, Prompt-Based, and Embedding-Based Adaptations1 Oct 2026
7. 2026MoRA: MoE Pruning via Router Bias Learning and Expert Approximation30 Sep 2026
8. 2026BaRe-Mem: Bayesian Reliability Memory for Robust and Adaptive Agent Consultation28 Sep 2026
9. 2026Fisher-Informed Recalibration for Feedback-Based On-Policy Self-Distillation of LLMs27 Sep 2026
10. 2026Stabilizing the Dynamic Low-Rank Training26 Sep 2026
11. 2026DualGuard: Dual-Mode Quality Control for Logic-Preserving Data Augmentation26 Sep 2026
12. 2026The Gold in Bias: Maturing the AI Design Process through Verification24 Sep 2026

50 newest of 1,718 · All 1,718 (JSON)

1. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
2. 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
3. 2023PaLM 2 Technical Reportcited by 1,154
4. 2022Large Language Models Can Self-Improvecited by 656
5. 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Modelscited by 328
6. 2022FOLIO: Natural Language Reasoning with First-Order Logiccited by 233
7. 2022Language Models of Code are Few-Shot Commonsense Learnerscited by 160
8. 2024BALROG: Benchmarking Agentic LLM and VLM Reasoning On Gamescited by 141
9. 2024Multi-Step Reasoning with Large Language Models, a Surveycited by 140
10. 2025BIG-Bench Extra Hardcited by 123
11. 2022NumGLUE: A Suite of Fundamental yet Challenging Mathematical Reasoning Taskscited by 110
12. 2023CLadder: Assessing Causal Reasoning in Language Modelscited by 102

12 most cited of 80 · All 80 (JSON)

1. 2026DualGuard: Dual-Mode Quality Control for Logic-Preserving Data Augmentation26 Sep 2026
2. 2026Easy to Complete, Hard to Choose: Investigating LLM Performance on the ProverbIT Benchmark5 Aug 2026
3. 2026Wazobia Eval: A Benchmark for Nigerian Pidgin Emotion Understanding, Sarcasm Detection, and Cultural Reasoning21 Jun 2026
4. 2026AstroMind: A High-Fidelity Benchmark for Spacecraft Behavior Reasoning Based on Large Language Models23 May 2026
5. 2026COINBench: Moving Beyond Individual Perspectives to Collective Intent Understanding22 Mar 2026
6. 2026Dropout Robustness and Cognitive Profiling of Transformer Models via Stochastic Inference18 Mar 2026
7. 2026BrainBench: Exposing the Commonsense Reasoning Gap in Large Language Models16 Mar 2026
8. 2026Semantic Invariance in Agentic AI13 Mar 2026
9. 2026TopoBench: Benchmarking LLMs on Hard Topological Reasoning12 Mar 2026
10. 2026SemBench: A Universal Semantic Framework for LLM Evaluation12 Mar 2026
11. 2026Abductive Reasoning with Syllogistic Forms in Large Language Models6 Mar 2026
12. 2026No One Size Fits All: QueryBandits for Hallucination Mitigation23 Feb 2026

12 newest of 80 · All 80 (JSON)

1. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
2. 2022Mixture-of-Experts with Expert Choice Routingcited by 611
3. 2022DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scalecited by 400
4. 2022ST-MoE: Designing Stable and Transferable Sparse Expert Modelscited by 391
5. 2022Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpointscited by 207
6. 2023Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuningcited by 148
7. 2022A Review of Sparse Expert Models in Deep Learningcited by 147
8. 2021FastMoE: A Fast Mixture-of-Expert Training Systemcited by 110
9. 2023FlexMoE: Scaling Large-scale Sparse Pre-trained Model Training via Dynamic Device Placementcited by 52
10. 2023SiDA-MoE: Sparsity-Inspired Data-Aware Serving for Efficient and Scalable Large Mixture-of-Experts Modelscited by 36
11. 2024STUN: Structured-Then-Unstructured Pruning for Scalable MoE Pruningcited by 30
12. 2023Diversifying the Mixture-of-Experts Representation for Language Models with Orthogonal Optimizercited by 28

12 most cited of 29 · All 29 (JSON)

1. 2026MoRA: MoE Pruning via Router Bias Learning and Expert Approximation30 Sep 2026
2. 2026SAMoRA: Semantic-Aware Mixture of LoRA Experts for Task-Adaptive Learning21 Apr 2026
3. 2025Routing Manifold Alignment Improves Generalization of Mixture-of-Experts LLMs10 Nov 2025
4. 2025Dynamic Adaptive Shared Experts with Grouped Multi-Head Attention Mixture of Experts5 Sep 2025
5. 2025MEPT: Mixture of Expert Prompt Tuning as a Manifold Mapper31 Aug 2025
6. 2025MoNE: Replacing Redundant Experts with Lightweight Novices for Structured Pruning of MoE1 Jul 2025
7. 2025Little by Little: Continual Learning via Incremental Mixture of Rank-1 Associative Memory Experts26 Jun 2025
8. 2025DynaMo: Runtime Switchable Quantization for MoE with Cross-Dataset Adaptation27 Mar 2025
9. 2024STUN: Structured-Then-Unstructured Pruning for Scalable MoE Pruning10 Sep 2024
10. 2024MoC-System: Efficient Fault Tolerance for Sparse Mixture-of-Experts Model Training8 Aug 2024
11. 2024How does Architecture Influence the Base Capabilities of Pre-trained Language Models? A Case Study Based on FFN-Wider and MoE Transformers4 Mar 2024
12. 2024PEMT: Multi-Task Correlation Guided Mixture-of-Experts Enables Parameter-Efficient Transfer Learning23 Feb 2024

12 newest of 29 · All 29 (JSON)

1. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
2. 2023Tool Learning with Foundation Modelscited by 302
3. 2022TALM: Tool Augmented Language Modelscited by 197
4. 2025Lifelong Learning of Large Language Model based Agents: A Roadmapcited by 78
5. 2026AIRS-Bench: a Suite of Tasks for Frontier AI Research Science Agentscited by 32
6. 2024Odyssey: Empowering Minecraft Agents with Open-World Skillscited by 26
7. 2025Procedural Environment Generation for Tool-Use Agentscited by 21
8. 2025OPT-BENCH: Evaluating LLM Agent on Large-Scale Search Spaces Optimization Problemscited by 12
9. 2025GVGAI-LLM: Evaluating Large Language Model Agents with Infinite Gamescited by 8
10. 2023Leveraging Word Guessing Games to Assess the Intelligence of Large Language Modelscited by 7
11. 2025Can an Individual Manipulate the Collective Decisions of Multi-Agents?cited by 5
12. 2026TowerMind: A Tower Defence Game Learning Environment and Benchmark for LLM as Agentscited by 4

12 most cited of 20 · All 20 (JSON)

1. 2026AutoGym: Blueprint-First Generation of Verifiable Agent Gyms18 Sep 2026
2. 2026Sigma-Mem: An Online Reliability Memory for LLM-based Multi-Agent Systems30 Jul 2026
3. 2026UniMem: Complementary Episodic-to-Parametric Memory for Boundary-Agnostic Task Streams28 Jul 2026
4. 2026SoK: AI Secure Code Generation: Progress, Pitfalls, and Paths Forward23 Jun 2026
5. 2026SkillVetBench: LLM-as-Judge for Multi-Dimensional Security Risk Evaluation in Open-Source LLM Agent Skills14 Jun 2026
6. 2026gwBenchmarks: Stress-Testing LLM Agents on High-Precision Gravitational Wave Astronomy11 May 2026
7. 2026AIRS-Bench: a Suite of Tasks for Frontier AI Research Science Agents6 Feb 2026
8. 2026TowerMind: A Tower Defence Game Learning Environment and Benchmark for LLM as Agents9 Jan 2026
9. 2025Can an Individual Manipulate the Collective Decisions of Multi-Agents?20 Sep 2025
10. 2025Talking with Oompa Loompas: A novel framework for evaluating linguistic acquisition of LLM agents9 Sep 2025
11. 2025GVGAI-LLM: Evaluating Large Language Model Agents with Infinite Games11 Aug 2025
12. 2025OPT-BENCH: Evaluating LLM Agent on Large-Scale Search Spaces Optimization Problems12 Jun 2025

12 newest of 20 · All 20 (JSON)

1. 2023Detecting Language Model Attacks with Perplexitycited by 411
2. 2024Defending Against Indirect Prompt Injection Attacks With Spotlightingcited by 233
3. 2023PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Promptscited by 218
4. 2023Explore, Establish, Exploit: Red Teaming Language Models from Scratchcited by 111
5. 2023Instructions as Backdoors: Backdoor Vulnerabilities of Instruction Tuning for Large Language Modelscited by 100
6. 2024The Butterfly Effect of Altering Prompts: How Small Changes and Jailbreaks Affect Large Language Model Performancecited by 97
7. 2021Membership Inference Attack Susceptibility of Clinical Language Modelscited by 50
8. 2022Prompt Injection: Parameterization of Fixed Inputscited by 35
9. 2024Towards Scalable Exact Machine Unlearning Using Parameter-Efficient Fine-Tuningcited by 25
10. 2022An Equivalence Between Data Poisoning and Byzantine Gradient Attackscited by 16
11. 2023Downstream Trade-offs of a Family of Text Watermarkscited by 14
12. 2025LLM Jailbreak Detection for (Almost) Free!cited by 13

12 most cited of 20 · All 20 (JSON)

1. 2025iSeal: Encrypted Fingerprinting for Reliable LLM Ownership Verification12 Nov 2025
2. 2025LLM Jailbreak Detection for (Almost) Free!18 Sep 2025
3. 2025Counterfactual Evaluation for Blind Attack Detection in LLM-based Evaluation Systems31 Jul 2025
4. 2025MEraser: An Effective Fingerprint Erasure Approach for Large Language Models14 Jun 2025
5. 2025What Are They Filtering Out? An Experimental Benchmark of Filtering Strategies for Harm Reduction in Pretraining Datasets17 Feb 2025
6. 2024Task-Agnostic Language Model Watermarking via High Entropy Passthrough Layers17 Dec 2024
7. 2024Learning and Unlearning of Fabricated Knowledge in Language Models29 Oct 2024
8. 2024Towards Scalable Exact Machine Unlearning Using Parameter-Efficient Fine-Tuning24 Jun 2024
9. 2024Is On-Device AI Broken and Exploitable? Assessing the Trust and Ethics in Small Language Models8 Jun 2024
10. 2024Defending Against Indirect Prompt Injection Attacks With Spotlighting20 Mar 2024
11. 2024The Butterfly Effect of Altering Prompts: How Small Changes and Jailbreaks Affect Large Language Model Performance8 Jan 2024
12. 2023Latent Feature-based Data Splits to Improve Generalisation Evaluation: A Hate Speech Detection Case Study16 Nov 2023

12 newest of 20 · All 20 (JSON)

1. 2022Training language models to follow instructions with human feedbackcited by 15,712
2. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
3. 2023Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervisioncited by 445
4. 2023Chain of Hindsight Aligns Language Models with Feedbackcited by 147
5. 2023AlignBench: Benchmarking Chinese Alignment of Large Language Modelscited by 68
6. 2023The Wisdom of Hindsight Makes Language Models Better Instruction Followerscited by 59
7. 2023TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Modelscited by 59
8. 2023MoCa: Measuring Human-Language Model Alignment on Causal and Moral Judgment Taskscited by 44
9. 2025R3: Robust Rubric-Agnostic Reward Modelscited by 22
10. 2023BabyStories: Can Reinforcement Learning Teach Baby Language Models to Write Better Stories?cited by 7
11. 2024HypoTermQA: Hypothetical Terms Dataset for Benchmarking Hallucination Tendency of LLMscited by 6
12. 2023CRaSh: Clustering, Removing, and Sharing Enhance Fine-tuning without Full Large Language Modelcited by 5

12 most cited of 15 · All 15 (JSON)

1. 2026SafeGene: Reusable Adapters for Transferable Safety Alignment2 Jun 2026
2. 2025Reimagining Safety Alignment with An Image1 Nov 2025
3. 2025R3: Robust Rubric-Agnostic Reward Models19 May 2025
4. 2024HypoTermQA: Hypothetical Terms Dataset for Benchmarking Hallucination Tendency of LLMs25 Feb 2024
5. 2023Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervision14 Dec 2023
6. 2023AlignBench: Benchmarking Chinese Alignment of Large Language Models30 Nov 2023
7. 2023TencentLLMEval: A Hierarchical Evaluation of Real-World Capabilities for Human-Aligned LLMs9 Nov 2023
8. 2023MoCa: Measuring Human-Language Model Alignment on Causal and Moral Judgment Tasks30 Oct 2023
9. 2023BabyStories: Can Reinforcement Learning Teach Baby Language Models to Write Better Stories?25 Oct 2023
10. 2023CRaSh: Clustering, Removing, and Sharing Enhance Fine-tuning without Full Large Language Model24 Oct 2023
11. 2023TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models10 Oct 2023
12. 2023The Wisdom of Hindsight Makes Language Models Better Instruction Followers10 Feb 2023

12 newest of 15 · All 15 (JSON)

1. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,075
2. 2023VisIT-Bench: A Benchmark for Vision-Language Instruction Following Inspired by Real-World Usecited by 100
3. 2022Perceptual Grouping in Contrastive Vision-Language Modelscited by 82
4. 2023SATIN: A Multi-Task Metadataset for Classifying Satellite Imagery using Vision-Language Modelscited by 15
5. 2022VLUE: A Multi-Task Benchmark for Evaluating Vision-Language Modelscited by 11
6. 2025Document Haystack: A Long Context Multimodal Image/Document Understanding Vision LLM Benchmarkcited by 6
7. 2024Repairs in a Block World: A New Benchmark for Handling User Corrections with Multi-Modal Language Modelscited by 3
8. 2024Using Game Play to Investigate Multimodal and Conversational Grounding in Large Multimodal Modelscited by 2
9. 2025VLMs Guided Interpretable Decision Making for Autonomous Drivingcited by 1
10. 2025Multimodal Evaluation of Russian-language Architecturescited by 1
11. 2023PRE: Vision-Language Prompt Learning with Reparameterization Encodercited by 0
12. 2026From Images to Words: Efficient Cross-Modal Knowledge Distillation to Language Models from Black-box Teacherscited by 0

12 most cited of 15 · All 15 (JSON)

1. 2026From Vision to Language: Investigating Causal Information Flow in Multimodal Decision-Making4 Sep 2026
2. 2026Groundbench: Multi-Resolution Polygon Grounding Exposes the Geometry Gap in Vision-Language Models18 Aug 2026
3. 2026AVI-Bench: Toward Human-like Audio-Visual Intelligence of Omni-MLLMs1 Jun 2026
4. 2026From Images to Words: Efficient Cross-Modal Knowledge Distillation to Language Models from Black-box Teachers11 Mar 2026
5. 2025Multimodal Evaluation of Russian-language Architectures19 Nov 2025
6. 2025VLMs Guided Interpretable Decision Making for Autonomous Driving17 Nov 2025
7. 2025Document Haystack: A Long Context Multimodal Image/Document Understanding Vision LLM Benchmark18 Jul 2025
8. 2024Repairs in a Block World: A New Benchmark for Handling User Corrections with Multi-Modal Language Models21 Sep 2024
9. 2024Using Game Play to Investigate Multimodal and Conversational Grounding in Large Multimodal Models20 Jun 2024
10. 2023PRE: Vision-Language Prompt Learning with Reparameterization Encoder14 Sep 2023
11. 2023VisIT-Bench: A Benchmark for Vision-Language Instruction Following Inspired by Real-World Use12 Aug 2023
12. 2023Kosmos-2: Grounding Multimodal Large Language Models to the World26 Jun 2023

12 newest of 15 · All 15 (JSON)

1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
2. 2023Benchmarking Large Language Models in Retrieval-Augmented Generationcited by 307
3. 2023ARES: An Automated Evaluation Framework for Retrieval-Augmented Generation Systemscited by 259
4. 2024Evaluation of Retrieval-Augmented Generation: A Surveycited by 146
5. 2024A Survey on Retrieval-Augmented Text Generation for Large Language Modelscited by 77
6. 2024Towards a Search Engine for Machines: Unified Ranking for Multiple Retrieval-Augmented Large Language Modelscited by 23
7. 2024Learning to Rank for Multiple Retrieval-Augmented Models through Iterative Utility Maximizationcited by 14
8. 2024Optimizing and Evaluating Enterprise Retrieval-Augmented Generation (RAG): A Content Design Perspectivecited by 7
9. 2024AlzheimerRAG: Multimodal Retrieval Augmented Generation for Clinical Use Cases using PubMed articlescited by 3
10. 2024Development of REGAI: Rubric Enabled Generative Artificial Intelligencecited by 1
11. 2025SEARA: An Automated Approach for Obtaining Optimal Retrieverscited by 0
12. 2025Breaking It Down: Domain-Aware Semantic Segmentation for Retrieval Augmented Generationcited by 0

12 most cited of 14 · All 14 (JSON)

1. 2026FAB-Bench: A Framework for Adaptive RAG Benchmarking in Semiconductor Manufacturing26 May 2026
2. 2026Domain Adaptation of Large Language Models for Polymer-Composite Additive Manufacturing Using Retrieval-Augmented Generation and Fine-Tuning2 Apr 2026
3. 2025Breaking It Down: Domain-Aware Semantic Segmentation for Retrieval Augmented Generation29 Nov 2025
4. 2025SEARA: An Automated Approach for Obtaining Optimal Retrievers9 Jul 2025
5. 2024AlzheimerRAG: Multimodal Retrieval Augmented Generation for Clinical Use Cases using PubMed articles21 Dec 2024
6. 2024Learning to Rank for Multiple Retrieval-Augmented Models through Iterative Utility Maximization13 Oct 2024
7. 2024Optimizing and Evaluating Enterprise Retrieval-Augmented Generation (RAG): A Content Design Perspective1 Oct 2024
8. 2024Development of REGAI: Rubric Enabled Generative Artificial Intelligence5 Aug 2024
9. 2024Evaluation of Retrieval-Augmented Generation: A Survey13 May 2024
10. 2024Towards a Search Engine for Machines: Unified Ranking for Multiple Retrieval-Augmented Large Language Models30 Apr 2024
11. 2024A Survey on Retrieval-Augmented Text Generation for Large Language Models17 Apr 2024
12. 2023ARES: An Automated Evaluation Framework for Retrieval-Augmented Generation Systems16 Nov 2023

12 newest of 14 · All 14 (JSON)

1. 2025Universal Model Routing for Efficient LLM Inferencecited by 80
2. 2025PDTrim: Targeted Pruning for Prefill-Decode Disaggregation in Inferencecited by 14
3. 2025Autoencoding-Free Context Compression for LLMs via Contextual Semantic Anchorscited by 14
4. 2023Revisiting Token Dropping Strategy in Efficient BERT Pretrainingcited by 11
5. 2024Tandem Transformers for Inference Efficient LLMscited by 10
6. 2024When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Modelscited by 9
7. 2024Selection-p: Self-Supervised Task-Agnostic Prompt Compression for Faithfulness and Transferabilitycited by 9
8. 2024HiRE: High Recall Approximate Top-k Estimation for Efficient LLM Inferencecited by 7
9. 2024ATP: Enabling Fast LLM Serving via Attention on Top Principal Keyscited by 1
10. 2026A Self-Pruning Transformer: Extreme KV-Cache Compression with Universal Attentioncited by 0

1. 2026A Self-Pruning Transformer: Extreme KV-Cache Compression with Universal Attention6 Oct 2026
2. 2025Autoencoding-Free Context Compression for LLMs via Contextual Semantic Anchors10 Oct 2025
3. 2025PDTrim: Targeted Pruning for Prefill-Decode Disaggregation in Inference29 Aug 2025
4. 2025Universal Model Routing for Efficient LLM Inference12 Feb 2025
5. 2024Selection-p: Self-Supervised Task-Agnostic Prompt Compression for Faithfulness and Transferability15 Oct 2024
6. 2024When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models11 Jun 2024
7. 2024ATP: Enabling Fast LLM Serving via Attention on Top Principal Keys1 Mar 2024
8. 2024HiRE: High Recall Approximate Top-k Estimation for Efficient LLM Inference14 Feb 2024
9. 2024Tandem Transformers for Inference Efficient LLMs13 Feb 2024
10. 2023Revisiting Token Dropping Strategy in Efficient BERT Pretraining24 May 2023

1. 2023Simple synthetic data reduces sycophancy in large language modelscited by 174
2. 2025AQuilt: Weaving Logic and Self-Inspection into Low-Cost, High-Relevance Data Synthesis for Specialist LLMscited by 4
3. 2023Synthetic Data Generation in Low-Resource Settings via Fine-Tuning of Large Language Modelscited by 3
4. 2023Uncertainty-aware Parameter-Efficient Self-training for Semi-supervised Language Understandingcited by 3
5. 2025Empowering LLMs in Decision Games through Algorithmic Data Synthesiscited by 1
6. 2023Mean BERTs make erratic language teachers: the effectiveness of latent bootstrapping in low-resource settingscited by 0
7. 2026Adaptive Decoding via Test-Time Policy Learning for Self-Improving Generationcited by 0

1. 2026Adaptive Decoding via Test-Time Policy Learning for Self-Improving Generation19 Mar 2026
2. 2025AQuilt: Weaving Logic and Self-Inspection into Low-Cost, High-Relevance Data Synthesis for Specialist LLMs24 Jul 2025
3. 2025Empowering LLMs in Decision Games through Algorithmic Data Synthesis18 Mar 2025
4. 2023Mean BERTs make erratic language teachers: the effectiveness of latent bootstrapping in low-resource settings30 Oct 2023
5. 2023Uncertainty-aware Parameter-Efficient Self-training for Semi-supervised Language Understanding19 Oct 2023
6. 2023Synthetic Data Generation in Low-Resource Settings via Fine-Tuning of Large Language Models2 Oct 2023
7. 2023Simple synthetic data reduces sycophancy in large language models7 Aug 2023

1. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 890
2. 2023Language Is Not All You Need: Aligning Perception with Language Modelscited by 543

1. 2023Language Is Not All You Need: Aligning Perception with Language Models27 Feb 2023
2. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Experts13 Dec 2021

1. 2025Masked Diffusion Language Models with Frequency-Informed Trainingcited by 2

1. 2025Masked Diffusion Language Models with Frequency-Informed Training5 Sep 2025

1. 2025Para-Lane: Multi-Lane Dataset Registering Parallel Scans for Benchmarking Novel View Synthesiscited by 9

1. 2025Para-Lane: Multi-Lane Dataset Registering Parallel Scans for Benchmarking Novel View Synthesis21 Feb 2025

1. 2025Reliable and Scalable Robot Policy Evaluation with Imperfect Simulatorscited by 13

1. 2025Reliable and Scalable Robot Policy Evaluation with Imperfect Simulators5 Oct 2025

1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
3. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
4. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
5. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
6. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
7. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
8. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
9. 2023A Survey of Large Language Modelscited by 2,537
10. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
11. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
12. 2022Visual Prompt Tuningcited by 1,674

12 most cited of 1,503 · All 1,503 (JSON)

1. 2026TACO: Ternary Absolute-max Column-wise One-sparse Optimizer for LLM Fine-Tuning1 Oct 2026
2. 2026Task-Oriented Rank Adaptation for Continual Learning in Text Classification1 Oct 2026
3. 2026Which LLM to pick? Online Active Model Selection for Large Language Models1 Oct 2026
4. 2026Why Does Train-Validation Separation Emerge? Update-Pressure Density Dynamics in Pretrained Backbones1 Oct 2026
5. 2026Efficient Task Adaptation in Large Language Models: A Survey of Weight-Based, Prompt-Based, and Embedding-Based Adaptations1 Oct 2026
6. 2026BaRe-Mem: Bayesian Reliability Memory for Robust and Adaptive Agent Consultation28 Sep 2026
7. 2026Fisher-Informed Recalibration for Feedback-Based On-Policy Self-Distillation of LLMs27 Sep 2026
8. 2026Stabilizing the Dynamic Low-Rank Training26 Sep 2026
9. 2026The Gold in Bias: Maturing the AI Design Process through Verification24 Sep 2026
10. 2026Linguistic Features for Interpretable Textual Entailment21 Sep 2026
11. 2026CogGym: Towards Large-Scale Comparative Evaluation of Human and Machine Cognition18 Sep 2026
12. 2026WiC is Not WSD: A Study on LLMs and Lexical Ambiguity Resolution17 Sep 2026

12 newest of 1,503 · All 1,503 (JSON)