IDRBench: Understanding the Capability of Large Language Models on Interdisciplinary Research
Not on the map. Why?
Abstract (arXiv)
Innovation is a key driving force of human civilization. As the body of knowledge has grown considerably, bridging knowledge across different disciplines, where significant innovation often emerges, has become increasingly challenging. The recent advancements in machine learning models, particularly Large Language Models (LLMs), have provided effective access to extensive knowledge sources and shown impressive abilities in reasoning, rendering significant opportunities for interdisciplinary discovery. Our research aims to understand the capabilities of state-of-the-art LLMs in integrating knowledge from different fields for interdisciplinary research (IDR). To address this fundamental problem, we introduce IDRBench, a pioneering framework that includes both datasets and evaluation tasks: (1) IDR Paper Identification, (2) IDR Idea Integration, and (3) IDR Idea Recommendation. Our study on ten mainstream LLMs provides a comprehensive analysis of their behavior and establishes benchmarks and baselines for future research. To the best of our knowledge, IDRBench is the first to provide a comprehensive investigation of LLMs' IDR capability.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 49 references that are in the map. First posted on arXiv 21 Jul 2025.
Builds on
18 of 49 references.
References · 18
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2017Neural Collaborative Filteringcited by 1,111
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 363
- 2023Large Language Models for Automated Open-domain Scientific Hypotheses Discoverycited by 100
- 2024MOOSE-Chem: Large Language Models for Rediscovering Unseen Chemistry Scientific Hypothesescited by 72
- 2025ResearchBench: Benchmarking LLMs in Scientific Discovery via Inspiration-Based Task Decompositioncited by 66
- 2024One fish, two fish, but not the whole sea: Alignment reduces language models' conceptual diversitycited by 58
- 2024SUPER: Evaluating Agents on Setting Up and Executing Tasks from Research Repositoriescited by 52
6 more
- 2025Base Models Beat Aligned Models at Randomness and Creativitycited by 51
- 2024Creativity Has Left the Chat: The Price of Debiasing Language Modelscited by 29
- 2023Meta-learning approaches for few-shot learning: A survey of recent advancescited by 25
- 2024PersonaFlow: Designing LLM-Simulated Expert Perspectives for Enhanced Research Ideationcited by 16
- 2015Measuring academic influence: Not all citations are equalcited by 11
- 2024DiscipLink: Unfolding Interdisciplinary Information Seeking Process via Human-AI Co-Explorationcited by 10
Built on by
Citing papers per year: 2025: 1.
1 paper.