Structural Diversity Drives Disruptive Scientific Innovation
Not on the map. Why?
Abstract (arXiv)
Scientific innovation increasingly depends on collaboration, yet the organizational structure that fosters breakthrough ideas remains poorly understood. Existing metrics - such as team size or compositional diversity - capture readily observable characteristics but not the deeper architecture of collaboration. We introduce Structural Diversity (SD): the extent to which a team bridges multiple distinct knowledge communities within its prior collaboration network. Using a century-scale dataset of 260 million scientific publications (1900-2025) and combining causal inference with a quasi-natural experiment based on a U.S. National Science Foundation policy change in 2012, we show that SD is a powerful and robust predictor of disruptive innovation, outperforming traditional team novelty indicators such as team freshness and edge density. Moreover, SD positively interacts with team size and is able to mitigate the well-known "curse of scale" by transforming scale from a liability into a resource for creative synthesis. We find that one mechanism underlying this effect is Disciplinary Integration (DI): teams with higher SD can more effectively combine heterogeneous knowledge into novel configurations. Our findings position SD as both a new theoretical construct and an actionable design principle for organizing scientific collaboration. By linking the architecture of team assembly to the dynamics of creative discovery, our work offers a structural explanation for how collective intelligence can be systematically engineered to foster disruptive innovation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 5 of its 29 references that are in the map. First posted on arXiv 2 Apr 2026.
Builds on
5 of 29 references.
References · 5
- 2022OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and conceptscited by 177
- 2020Neural Embeddings of Scholarly Periodicals Reveal Complex Disciplinary Organizationscited by 16
- 2024Promotional Language and the Adoption of Innovative Ideas in Sciencecited by 8
- 2022The Gender Gap in Scholarly Self-Promotion on Social Mediacited by 3
- 2018The Chaperone Effect in Scientific Publishingcited by 2
Built on by
Not cited yet.