Datasheets for Datasets
Not on the map. Why?
Cited by 51 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
The machine learning community currently has no standardized process for documenting datasets, which can lead to severe consequences in high-stakes domains. To address this gap, we propose datasheets for datasets. In the electronics industry, every component, no matter how simple or complex, is accompanied with a datasheet that describes its operating characteristics, test results, recommended uses, and other information. By analogy, we propose that every dataset be accompanied with a datasheet that documents its motivation, composition, collection process, recommended uses, and so on. Datasheets for datasets will facilitate better communication between dataset creators and dataset consumers, and encourage the machine learning community to prioritize transparency and accountability.
Key facts. Cited by 1,371 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 139; 2022: 196; 2023: 227; 2024: 254; 2025: 180; 2026: 374.
1,371 papers.
Sort:
By area:
- 2023Segment Anythingcited by 8,158
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
- 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
- 2023PaLM 2 Technical Reportcited by 1,154
- 2021Measuring Coding Challenge Competence With APPScited by 879
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
- 2022PaLI: A Jointly-Scaled Multilingual Language-Image Modelcited by 762
38 more
- 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 755
- 2020Aligning AI With Shared Human Valuescited by 706
- 2021Deduplicating Training Data Makes Language Models Bettercited by 705
- 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 702
- 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 666
- 2023Bias and Fairness in Large Language Models: A Surveycited by 626
- 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 527
- 2021Datasets: A Community Library for Natural Language Processingcited by 526
- 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Modelscited by 501
- 2021Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpuscited by 481
- 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 469
- 2021Retiring Adult: New Datasets for Fair Machine Learningcited by 443
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
- 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 376
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
- 2022The Stack: 3 TB of permissively licensed source codecited by 354
- 2021AI and the Everything in the Whole Wide World Benchmarkcited by 340
- 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
- 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Modelscited by 328
- 2021MERLOT: Multimodal Neural Script Knowledge Modelscited by 311
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 266
- 2023Mathematical Capabilities of ChatGPTcited by 263
- 2021IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoningcited by 262
- 2021Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detectioncited by 258
- 2024LiveBench: A Challenging, Contamination-Limited LLM Benchmarkcited by 242
- 2021Quality at a Glance: An Audit of Web-Crawled Multilingual Datasetscited by 241
- 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
- 2021Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Modelscited by 227
- 2021Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptionscited by 226
- 2023When Do Neural Nets Outperform Boosted Trees on Tabular Data?cited by 218
- 2023An Overview of Catastrophic AI Riskscited by 214
- 2024BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystackcited by 211
- 2023Multimodal C4: An Open, Billion-scale Corpus of Images Interleaved with Textcited by 208
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2021Societal Biases in Language Generation: Progress and Challengescited by 201
- 2021What Will it Take to Fix Benchmarking in Natural Language Understanding?cited by 200
- 2023Quilt-1M: One Million Image-Text Pairs for Histopathologycited by 192
- 2022MERLOT Reserve: Neural Script Knowledge through Vision and Language and Soundcited by 184
50 most cited of 1,371 All 1,371 (JSON)
- 2026The AI Assessment Sandbox Configurator: A Framework to Support Technical Assessment in AI Regulatory Sandboxes1 Oct 2026
- 2026Generation Provenance Before Behavior Attribution: Auditing Synthetic Speech Research Objects1 Oct 2026
- 2026A Matched-Budget Audit Framework for Recaptioned Image-Text Supervision Distributions1 Oct 2026
- 2026FAER: Auditable Utility-Aligned Trajectory Replay for Language Model Post-Training30 Sep 2026
- 2026ViTeX-Bench: Benchmarking High-Fidelity Video Scene Text Editing30 Sep 2026
- 2026Agent Error Dataset: Scaling 50,000 Error--Diagnosis Pairs for Failure Analysis and Error-Aware Post-Training30 Sep 2026
- 2026ArchitectureIQ: On the Measure of Training Intuition30 Sep 2026
- 2026Whose Voice Survives the Summary? A Voice-Retention Audit of LLM Employee Listening30 Sep 2026
- 2026SHIFT-Truck: A High-Fidelity Aerodynamics Dataset and Benchmark for Pickup Trucks29 Sep 2026
- 2026From Neurons to Conversation: Speech Brain-Computer Interfaces29 Sep 2026
- 2026PairPref: When Should Memory Guide the Answer? A Benchmark for Contextual Preference Use28 Sep 2026
- 2026When Does an Image Determine the Answer? Benchmarking Visual Answerability across Charts and Scenes28 Sep 2026
38 more
- 2026The Last Mile Is the File: OfficeEditBench for Preservation-Aware Office Editing28 Sep 2026
- 2026PhysioTRACE: Provenance-Aware Stress Tests for Physiological Foundation Models28 Sep 2026
- 2026Trustworthy synthetic visual media: Evidence across the media lifecycle28 Sep 2026
- 2026When Evidence Changes the Subject: Subject-Typed Claim Licensing for Learned Routing27 Sep 2026
- 2026PhysAlign: A Benchmark for Evidence-Grounded Role Alignment in Multimodal Physics Reasoning27 Sep 2026
- 2026CORTEX: A Verified Experience Layer for Generalist Agents27 Sep 2026
- 2026Beyond Accuracy: Counterfactual Fragility and Demographic Bias in Clinical Evaluation of LLMs26 Sep 2026
- 2026PriceBench: A Diagnostic Benchmark for Price, Quality, and Brand Preferences in LLM Booking Agents25 Sep 2026
- 2026Rethinking Data Quality for AI-Driven Systems: Evidence from Practitioner Interviews25 Sep 2026
- 2026Evidence-Grounded Auditing of Identification Assumptions in Climate-Policy Causal Evaluations25 Sep 2026
- 2026TWIST: A Proposed Benchmark for Intervention Quality in Conversational Memory, with a Human-Validated Draft-Alignment23 Sep 2026
- 2026Consequential Behaviour and Representational Fairness in the Validation of Synthetic Research23 Sep 2026
- 2026FDE-Bench: Evaluating LLM Agents for Deployment Environment Configuration23 Sep 2026
- 2026Reciprocal Collaboration: how lessons from convergence in GLAMs can enhance interdisciplinary AI research22 Sep 2026
- 2026FineWeb-CLaR: Culture, Language, and Region Annotations for Benchmark-Aligned Corpus Auditing21 Sep 2026
- 2026ReSTI: A Source-Grounded Audit and Repair of STI-Bench21 Sep 2026
- 2026You Can Tell Who's Asking: What the Web's Questions Are Made Of, and Where They Come From21 Sep 2026
- 2026ETH-TraceBench: A Large-Scale Event-Stream Benchmark for Ethereum DeFi under Temporal, Protocol, and Contract Shift20 Sep 2026
- 2026LEGIT: Credentialing Protocol for Trustworthy AI Agent Marketplaces18 Sep 2026
- 2026FairLMs: A Turnkey Library for Fairness in Language Models18 Sep 2026
- 2026Governance-as-Code: Translating EU AI Act Technical Requirements into Executable Compliance Pipelines for Generative AI Systems17 Sep 2026
- 2026TeleAntiFraud 2.0: A Refreshable, Profile-Grounded, and Audio-Based Benchmark for Telecom Fraud Detection16 Sep 2026
- 2026QuanText: Protecting Dataset-Level Secrets in Textual Data Sharing16 Sep 2026
- 2026Turkish MMLU Pro: Traceable Option Augmentation and Its Validity Limits in Turkish Multiple-Choice Evaluation14 Sep 2026
- 2026From Ideas to Actions: A Public-Data Decision-Support Toolchain Across the Venture Lifecycle14 Sep 2026
- 2026When does a scaling result justify a different allocation? A critical review of resource-allocation evidence for AI systems13 Sep 2026
- 2026Phorecaster365: A Human-Supervised Reference Architecture for Hybrid Pharmaceutical Sales Forecasting and Planning Decision Support12 Sep 2026
- 2026When Compliance Data Masquerades as Evaluation: Measurement Validity for Deployed AI Systems12 Sep 2026
- 2026DeFiFlowBench: Benchmarking and Improving Safe Executability in Natural-Language DeFi Workflow Synthesis10 Sep 2026
- 2026Prevalence Determines Precision:Silent Contamination in Detector-Defined Datasets10 Sep 2026
- 2026Assessing the Reusability of Public Speech Resources for Low-Resource Languages: A Central Kurdish Case Study10 Sep 2026
- 2026Benchmark Radar: A Living Database and Search Engine for AI Benchmarks and Evaluation10 Sep 2026
- 2026The Agent Incident Registry: Toward Preventing Repeated AI Agent Failures10 Sep 2026
- 2026Silent Revision: Measuring Undisclosed Change in the Safety Frameworks of Frontier AI Developers8 Sep 2026
- 2026AgentDrift: A Step-Labeled Benchmark of Injection-Hijacked LLM Agent Trajectories7 Sep 2026
- 2026Used, Mentioned, or Condemned? A Controlled Contrast-Set Diagnostic for the Use-Mention Distinction in Code-Mixed Hinglish Misogyny Detection6 Sep 2026
- 2026Which Part of the Context Layer Does the Work? Separating Semantic Content from Retrieval Scaffolding in Text-to-SQL Agents6 Sep 2026
- 2026The Double Measurement Confound in Agent Benchmarks: De-Scaffolding, Ground-Truth Scoring, and Reliability Beyond the Mean6 Sep 2026
50 newest of 1,371 All 1,371 (JSON)
- 2023Harms from Increasingly Agentic Algorithmic Systemscited by 134
- 2025Retrieval Models Aren't Tool-Savvy: Benchmarking Tool Retrieval for Large Language Modelscited by 46
- 2026The 2025 AI Agent Index: Documenting Technical and Safety Features of Deployed Agentic AI Systemscited by 27
- 2025The AI Agent Indexcited by 14
- 2026Auditable Agentscited by 14
- 2024SceneGenAgent: Precise Industrial Scene Generation with Coding Agentcited by 12
- 2026RewardHackingAgents: Benchmarking Evaluation Integrity for LLM ML-Engineering Agentscited by 10
- 2025Agentic Services Computingcited by 6
- 2026What Twelve LLM Agent Benchmark Papers Disclose About Themselves: A Pilot Audit and an Open Scoring Schemacited by 6
- 2024GenoTEX: An LLM Agent Benchmark for Automated Gene Expression Data Analysiscited by 5
- 2026SARC: A Governance-by-Architecture Framework for Agentic AI Systemscited by 5
- 2026ContextEcho: A Benchmark for Persona Drift in Long Agentic-Coding Sessionscited by 5
12 most cited of 50 All 50 (JSON)
- 2026Agent Error Dataset: Scaling 50,000 Error--Diagnosis Pairs for Failure Analysis and Error-Aware Post-Training30 Sep 2026
- 2026FDE-Bench: Evaluating LLM Agents for Deployment Environment Configuration23 Sep 2026
- 2026LEGIT: Credentialing Protocol for Trustworthy AI Agent Marketplaces18 Sep 2026
- 2026AgentDrift: A Step-Labeled Benchmark of Injection-Hijacked LLM Agent Trajectories7 Sep 2026
- 2026The Double Measurement Confound in Agent Benchmarks: De-Scaffolding, Ground-Truth Scoring, and Reliability Beyond the Mean6 Sep 2026
- 2026What Does an Agentic Software Engineering Benchmark Measure? Profiling Task Demands and Agent Behaviour Beyond What Category Labels Reveal1 Sep 2026
- 2026PII-TRACE: A Benchmark for Context-Aware PII Detection in Multi-Turn LLM Conversations31 Aug 2026
- 2026TraceML: An Empirical Analysis of Human-Agent Planning in Machine Learning Development26 Aug 2026
- 2026ADeptS-Bench: Measuring the Trustworthiness of Computer Use Agents Across Devices25 Aug 2026
- 2026Agent Gym: A Framework for Continuous Evaluation and Evolution of LLM Agents Through Human-in-the-Loop Feedback16 Aug 2026
- 2026Harness-IF: Evaluating Instruction Following Across Instruction Surfaces in Coding Agents12 Aug 2026
- 2026Capability Is Not Propensity: Measuring Pressure-Robust Cooperative Behavior in Civic LLM Agents10 Aug 2026
12 newest of 50 All 50 (JSON)
- 2023PaLM 2 Technical Reportcited by 1,154
- 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Modelscited by 328
- 2024BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystackcited by 211
- 2022Impact of Pretraining Term Frequencies on Few-Shot Reasoningcited by 142
- 2024Test of Time: A Benchmark for Evaluating LLMs on Temporal Reasoningcited by 83
- 2022The Abduction of Sherlock Holmes: A Dataset for Visual Abductive Reasoningcited by 38
- 2025CausalVQA: A Physically Grounded Causal Reasoning Benchmark for Video Modelscited by 35
- 2024LINGOLY: A Benchmark of Olympiad-Level Linguistic Reasoning Puzzles in Low-Resource and Extinct Languagescited by 28
- 2024ReMI: A Dataset for Reasoning with Multiple Imagescited by 27
- 2022From Black Boxes to Conversations: Incorporating XAI in a Conversational Agentcited by 14
- 2025BioProBench: A Corpus and Benchmark for Biological Protocol Reasoning in Autonomous Sciencecited by 14
- 2022Interactive Visual Reasoning under Uncertaintycited by 8
12 most cited of 34 All 34 (JSON)
- 2026OpenDiscoveryTrace: Process Traces for Evaluating AI Scientist Workflows5 Sep 2026
- 2026SCAFFOLD: A Large-Scale Structured Dataset of Computer Science Research Figures with Diagram QA and Chain-of-Thought Reasoning Traces20 Aug 2026
- 2026Nigeria Machinery: A Low-Resource Industrial Dataset with a Domain-Grounded Reasoning Layer8 Jul 2026
- 2026MacroLens: A Multi-Task Benchmark for Contextual Financial Reasoning under Macroeconomic Scenarios23 Jun 2026
- 2026When the Chain of Thought Knows Better: Failure Modes in Multi-Turn Reasoning Models9 Jun 2026
- 2026MemoryDocDataSet: A Benchmark for Joint Conversational Memory and Long Document Reasoning3 Jun 2026
- 2026UA-Legal-Bench: A Benchmark for Evaluating Large Language Models on Ukrainian Legal Reasoning27 May 2026
- 2026Positional Failures in Long-Context LLMs: A Blind Spot in Reasoning Benchmarks22 May 2026
- 2026ChronoMedKG: A Temporally-Grounded Biomedical Knowledge Graph and Benchmark for Clinical Reasoning21 May 2026
- 2026Contextual Multi-Objective Optimization: Rethinking Objectives in Frontier AI Systems5 May 2026
- 2026EsoLang-Bench: Evaluating Genuine Reasoning in Large Language Models via Esoteric Programming Languages10 Mar 2026
- 2026CausalReasoningBenchmark: A Real-World Benchmark for Disentangled Evaluation of Causal Identification and Estimation24 Feb 2026
12 newest of 34 All 34 (JSON)
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2022A Prompt Array Keeps the Bias Away: Debiasing Vision-Language Models with Adversarial Learningcited by 104
- 2024MedTrinity-25M: A Large-scale Multimodal Dataset with Multigranular Annotations for Medicinecited by 79
- 2023DeAR: Debiasing Vision-Language Models with Additive Residualscited by 70
- 2023VisoGender: A dataset for benchmarking gender bias in image-text pronoun resolutioncited by 52
- 2024From Pixels to Prose: A Large Dataset of Dense Image Captionscited by 52
- 2025XLRS-Bench: Could Your Multimodal LLMs Understand Extremely Large Ultra-High-Resolution Remote Sensing Imagery?cited by 50
- 2025GeoLLaVA-8K: Scaling Remote-Sensing Multimodal Large Language Models to 8K Resolutioncited by 41
- 2024Good at captioning, bad at counting: Benchmarking GPT-4V on Earth observation datacited by 39
- 2024Fairness and Bias in Multimodal AI: A Surveycited by 19
- 2025HumaniBench: A Human-Centric Framework for Large Multimodal Models Evaluationcited by 19
- 2024What to Say and When to Say it: Live Fitness Coaching as a Testbed for Situated Interactioncited by 18
12 most cited of 29 All 29 (JSON)
- 2026Good Memory Has ECC: Evaluating the Memory of Vision-Language Models Beyond Accuracy31 Aug 2026
- 2026GeoAgent: Evaluating VLM Geolocalization Through Embodied Navigation30 Aug 2026
- 2026Vision Language Model Fusion for Explainable Face Recognition25 Aug 2026
- 2026BanglaWild: An In-the-Wild Bengali Scene Text Recognition Benchmark for OCR and Vision-Language Models4 Aug 2026
- 2026Forensic Reproducibility Audit of a Radiology Vision-Language Model Benchmark: From Intended Protocol to Released Artifact28 Jul 2026
- 2026Auditing Data Leakage in Whole-Slide Image Multimodal Benchmarks14 Jul 2026
- 2026SteelBench: Evaluating Vision-Language Models in Real-World Industrial Environments6 Jul 2026
- 2026Benchmarks for Vision-Language Models in Urban Perception Should Be Reliability-Aware and Negotiated30 May 2026
- 2026Perception or Prejudice: Can MLLMs Go Beyond First Impressions of Personality?21 May 2026
- 2026DisasterVQA: A Visual Question Answering Benchmark Dataset for Disaster Scenes20 Jan 2026
- 2025OVFact: Measuring and Improving Open-Vocabulary Factuality for Long Caption Models25 Jul 2025
- 2025GeoLLaVA-8K: Scaling Remote-Sensing Multimodal Large Language Models to 8K Resolution27 May 2025
12 newest of 29 All 29 (JSON)
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Modelscited by 501
- 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 376
- 2024UnlearnCanvas: Stylized Image Dataset for Enhanced Machine Unlearning Evaluation in Diffusion Modelscited by 47
- 2024SteerDiff: Steering towards Safe Text-to-Image Diffusion Modelscited by 10
- 2025CNS-Bench: Benchmarking Image Classifier Robustness Under Continuous Nuisance Shiftscited by 2
- 2025Comprehensive Evaluation and Analysis for NSFW Concept Erasure in Text-to-Image Diffusion Modelscited by 1
- 2022Implementing and Experimenting with Diffusion Models for Text-to-Image Generationcited by 0
- 2025Comprehensive Assessment and Analysis for NSFW Content Erasure in Text-to-Image Diffusion Modelscited by 0
- 2025Towards SFW sampling for diffusion models via external conditioningcited by 0
- 2025SafeGen: Embedding Ethical Safeguards in Text-to-Image Generationcited by 0
- 2026Active Tabular Augmentation via Policy-Guided Diffusion Inpaintingcited by 0
- 2026Active Tabular Augmentation via Policy-Guided Diffusion Inpainting11 May 2026
- 2025SafeGen: Embedding Ethical Safeguards in Text-to-Image Generation14 Dec 2025
- 2025CNS-Bench: Benchmarking Image Classifier Robustness Under Continuous Nuisance Shifts23 Jul 2025
- 2025Comprehensive Evaluation and Analysis for NSFW Concept Erasure in Text-to-Image Diffusion Models21 May 2025
- 2025Towards SFW sampling for diffusion models via external conditioning12 May 2025
- 2025Comprehensive Assessment and Analysis for NSFW Content Erasure in Text-to-Image Diffusion Models18 Feb 2025
- 2024SteerDiff: Steering towards Safe Text-to-Image Diffusion Models3 Oct 2024
- 2024UnlearnCanvas: Stylized Image Dataset for Enhanced Machine Unlearning Evaluation in Diffusion Models19 Feb 2024
- 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Models9 Nov 2022
- 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Models26 Oct 2022
- 2022Implementing and Experimenting with Diffusion Models for Text-to-Image Generation22 Sep 2022
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May 2022
- 2023Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-4cited by 123
- 2023Ignore This Title and HackAPrompt: Exposing Systemic Vulnerabilities of LLMs through a Global Scale Prompt Hacking Competitioncited by 65
- 2024LlavaGuard: An Open VLM-based Framework for Safeguarding Vision Datasets and Modelscited by 49
- 2024Code-Switching Red-Teaming: LLM Evaluation for Safety and Multilingual Understandingcited by 34
- 2024Detecting Training Data of Large Language Models via Expectation Maximizationcited by 13
- 2026Towards Policy-Adaptive Image Guardrail: Benchmark and Methodcited by 6
- 2026StepShield: When, Not Whether to Intervene on Rogue Agentscited by 5
- 2025A Linear Approach to Data Poisoningcited by 2
- 2025What Are They Filtering Out? An Experimental Benchmark of Filtering Strategies for Harm Reduction in Pretraining Datasetscited by 1
- 2025Are LLMs Enough for Hyperpartisan, Fake, Polarized and Harmful Content Detection? Evaluating In-Context Learning vs. Fine-Tuningcited by 1
- 2025Defending Large Language Models Against Jailbreak Exploits with Responsible AI Considerationscited by 0
- 2026Beyond Native Success: Auditing Deployment-Interface Exposure of CLIP Backdoorscited by 0
- 2026Beyond Native Success: Auditing Deployment-Interface Exposure of CLIP Backdoors16 Jun 2026
- 2026Towards Policy-Adaptive Image Guardrail: Benchmark and Method1 Mar 2026
- 2026StepShield: When, Not Whether to Intervene on Rogue Agents29 Jan 2026
- 2025Defending Large Language Models Against Jailbreak Exploits with Responsible AI Considerations24 Nov 2025
- 2025Are LLMs Enough for Hyperpartisan, Fake, Polarized and Harmful Content Detection? Evaluating In-Context Learning vs. Fine-Tuning9 Sep 2025
- 2025A Linear Approach to Data Poisoning21 May 2025
- 2025What Are They Filtering Out? An Experimental Benchmark of Filtering Strategies for Harm Reduction in Pretraining Datasets17 Feb 2025
- 2024Detecting Training Data of Large Language Models via Expectation Maximization10 Oct 2024
- 2024Code-Switching Red-Teaming: LLM Evaluation for Safety and Multilingual Understanding17 Jun 2024
- 2024LlavaGuard: An Open VLM-based Framework for Safeguarding Vision Datasets and Models7 Jun 2024
- 2023Ignore This Title and HackAPrompt: Exposing Systemic Vulnerabilities of LLMs through a Global Scale Prompt Hacking Competition24 Oct 2023
- 2023Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-428 Apr 2023
- 2020Aligning AI With Shared Human Valuescited by 706
- 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 702
- 2025Whose Personae? Synthetic Persona Experiments in LLM Research and Pathways to Transparencycited by 14
- 2024The Future of Open Human Feedbackcited by 10
- 2025Societal Alignment Frameworks Can Improve LLM Alignmentcited by 8
- 2025LIVS: A Pluralistic Alignment Dataset for Inclusive Public Spacescited by 8
- 2023FigCaps-HF: A Figure-to-Caption Generative Framework and Benchmark with Human Feedbackcited by 7
- 2024The Root Shapes the Fruit: On the Persistence of Gender-Exclusive Harms in Aligned Language Modelscited by 5
- 2026Incoherent Values? Probing LLM Preferences Through Parametric Variationcited by 2
- 2026Align AI to Dynamic Human-AI Workflowscited by 0
- 2026Align AI to Dynamic Human-AI Workflows15 Jul 2026
- 2026Incoherent Values? Probing LLM Preferences Through Parametric Variation19 Jun 2026
- 2025Whose Personae? Synthetic Persona Experiments in LLM Research and Pathways to Transparency29 Nov 2025
- 2025LIVS: A Pluralistic Alignment Dataset for Inclusive Public Spaces27 Feb 2025
- 2025Societal Alignment Frameworks Can Improve LLM Alignment27 Feb 2025
- 2024The Root Shapes the Fruit: On the Persistence of Gender-Exclusive Harms in Aligned Language Models6 Nov 2024
- 2024The Future of Open Human Feedback15 Aug 2024
- 2023FigCaps-HF: A Figure-to-Caption Generative Framework and Benchmark with Human Feedback20 Jul 2023
- 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned23 Aug 2022
- 2020Aligning AI With Shared Human Values5 Aug 2020
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
- 2024CodeRAG-Bench: Can Retrieval Augment Code Generation?cited by 89
- 2024WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipediacited by 43
- 2025Pneuma: Leveraging LLMs for Tabular Data Representation and Retrieval in an End-to-End Systemcited by 22
- 2026Retrieval Collapses When AI Pollutes the Webcited by 4
- 2025MetaRAG: Metamorphic Testing for Hallucination Detection in RAG Systemscited by 2
- 2026Same Question, Different Source, Different Answer: Auditing Source-Dependence in Medical Multi-Source RAGcited by 0
- 2026Beyond the Reranker: Do RAG Retrieval Enhancements Help Once a Strong Reranker Is Present?cited by 0
- 2026Beyond the Reranker: Do RAG Retrieval Enhancements Help Once a Strong Reranker Is Present?14 Jun 2026
- 2026Same Question, Different Source, Different Answer: Auditing Source-Dependence in Medical Multi-Source RAG27 May 2026
- 2026Retrieval Collapses When AI Pollutes the Web18 Feb 2026
- 2025MetaRAG: Metamorphic Testing for Hallucination Detection in RAG Systems11 Sep 2025
- 2025Pneuma: Leveraging LLMs for Tabular Data Representation and Retrieval in an End-to-End System12 Apr 2025
- 2024CodeRAG-Bench: Can Retrieval Augment Code Generation?20 Jun 2024
- 2024WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia19 Jun 2024
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Models27 Jun 2023
- 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 469
- 2021Modeling Worlds in Textcited by 11
- 2026DECOWAM: Decoupled Whole-Body World-Action Model for Legged Mobile Manipulationcited by 3
- 2026DECOWAM: Decoupled Whole-Body World-Action Model for Legged Mobile Manipulation20 Aug 2026
- 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge17 Jun 2022
- 2021Modeling Worlds in Text17 Jun 2021
- 2023Segment Anythingcited by 8,158
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
- 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
- 2021Measuring Coding Challenge Competence With APPScited by 879
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
- 2022PaLI: A Jointly-Scaled Multilingual Language-Image Modelcited by 762
- 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 755
- 2021Deduplicating Training Data Makes Language Models Bettercited by 705
- 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 666
12 most cited of 1,209 All 1,209 (JSON)
- 2026The AI Assessment Sandbox Configurator: A Framework to Support Technical Assessment in AI Regulatory Sandboxes1 Oct 2026
- 2026Generation Provenance Before Behavior Attribution: Auditing Synthetic Speech Research Objects1 Oct 2026
- 2026A Matched-Budget Audit Framework for Recaptioned Image-Text Supervision Distributions1 Oct 2026
- 2026FAER: Auditable Utility-Aligned Trajectory Replay for Language Model Post-Training30 Sep 2026
- 2026ViTeX-Bench: Benchmarking High-Fidelity Video Scene Text Editing30 Sep 2026
- 2026ArchitectureIQ: On the Measure of Training Intuition30 Sep 2026
- 2026Whose Voice Survives the Summary? A Voice-Retention Audit of LLM Employee Listening30 Sep 2026
- 2026SHIFT-Truck: A High-Fidelity Aerodynamics Dataset and Benchmark for Pickup Trucks29 Sep 2026
- 2026From Neurons to Conversation: Speech Brain-Computer Interfaces29 Sep 2026
- 2026PairPref: When Should Memory Guide the Answer? A Benchmark for Contextual Preference Use28 Sep 2026
- 2026When Does an Image Determine the Answer? Benchmarking Visual Answerability across Charts and Scenes28 Sep 2026
- 2026The Last Mile Is the File: OfficeEditBench for Preservation-Aware Office Editing28 Sep 2026
12 newest of 1,209 All 1,209 (JSON)