mlsanityData to 14 Oct 2026

Diagnostic Foundation for Evaluating LLMs' Research Integrity as Co-Scientists

arXiv 2608.12345 ↗First posted 3 Jun 2026cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Language models are increasingly deployed as co-scientists, yet their ability to uphold research integrity under institutional pressure remains unmeasured. We introduce IntegrityBench, a benchmark evaluating misconduct classification, ethical action reasoning and artifact-grounded decision making across 36 paired tasks under a 5-level implicit-explicit pressure protocol spanning 3 domains and 4 research stages. Evaluating 18 frontier model variants, we find that under peak pressure, models fail roughly 1 in 3 integrity-critical decisions, and neither scale nor reasoning ability reliably mitigates this. Explicit pressures induce compliance with misconduct, while implicit contextual reframing more often causes over-refusal of legitimate research tasks. Interestingly, models failing to classify research requests accurately perform equally or better on artifact-grounded decision making (85.7 vs. 79.4), suggesting the three facets are structurally dissociated and correct ethical action does not require accurate classification. Frontier models can thus appear helpful while harbouring integrity failures that create two distinct deployment risks: facilitating research misconduct and eroding trust in AI-assisted research.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 31 references that are in the map. First posted on arXiv 3 Jun 2026.

Builds on

10 of 31 references.

References · 10

  1. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
  2. 2024CycleResearcher: Improving Automated Research via Automated Reviewcited by 148
  3. 2024Language agents achieve superhuman synthesis of scientific knowledgecited by 137
  4. 2024Hypothesis Generation with Large Language Modelscited by 71
  5. 2025DeceptionBench: A Comprehensive Benchmark for AI Deception Behaviors in Real-world Scenarioscited by 19
  6. 2025ML-Dev-Bench: Comparative Analysis of AI Agents on ML development workflowscited by 17
  7. 2026HeurekaBench: A Benchmarking Framework for AI Co-scientistcited by 12
  8. 2026Failing to Falsify: Evaluating and Mitigating Confirmation Bias in Language Modelscited by 9
  9. 2026Good Arguments Against the People Pleasers: How Reasoning Mitigates (Yet Masks) LLM Sycophancycited by 8
  10. 2026ForesightSafety Bench: A Frontier Risk Evaluation and Governance Framework towards Safe AIcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Malicious Repurposing of Open Science Artefacts by Using Large Language Models
  2. 2026How Researchers Navigate Accountability, Transparency, and Trust When Using AI Tools in Early-Stage Research: A Think-Aloud Study
  3. 2025SciTrust 2.0: A Comprehensive Framework for Evaluating Trustworthiness of Large Language Models in Scientific Applications
  4. 2026Ethical LLM-Assisted Research: A Framework for Responsible Delegation, Verification, and Epistemic Value
  5. 2025Mapping Trustworthiness in Large Language Models: A Bibliometric Analysis Bridging Theory to Practice
  6. 2026ContextAdapt: Evaluating Contextual Adaptation and Value Alignment in LLMs
  7. 2026LLMs learn scientific taste from institutional traces across the social sciences
  8. 2026ScientistOne: Towards Human-Level Autonomous Research via Chain-of-Evidence