SciIntBench: Measuring LLM Compliance with Research Integrity Norms Under Adversarial Framing
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly used to support scientific work, but it is unclear whether they uphold responsible conduct of research (RCR) norms or help undermine them. We introduce SciIntBench, an adversarial benchmark of 810 prompts across ten RCR categories and three scientific domains. Each scenario appears as an Overt Adversarial, Covert Adversarial, and Benign version, allowing us to jointly measure framing-sensitive refusal of misconduct and helpfulness on legitimate requests. We evaluate 16 commercial and open-weight LLMs from six providers (2024--2026), producing 12,960 responses. We find that scientific integrity alignment is strongly framing-sensitive: models refuse explicit misconduct far more reliably than covert violations, especially failing when misconduct is presented as a pressure-driven shortcut. Refusals vary by RCR category, with weaker boundaries around transparency, plagiarism, and fabrication.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 7 of its 27 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
7 of 27 references.
References · 7
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
- 2026Towards End-to-End Automation of AI Researchcited by 150
- 2024LLMs know their vulnerabilities: Uncover Safety Gaps through Natural Distribution Shiftscited by 80
- 2025FalseReject: A Resource for Improving Contextual Safety and Mitigating Over-Refusals in LLMs via Structured Reasoningcited by 53
- 2025SoSBench: Benchmarking Safety Alignment on Six Scientific Domainscited by 11
- 2025No for Some, Yes for Others: Persona Prompts and Other Sources of False Refusal in Language Modelscited by 8
- 2025TRIDENT: Enhancing Large Language Model Safety with Tri-Dimensional Diversified Red-Teaming Data Synthesiscited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.