A review on the novelty measurements of academic papers
Not on the map. Why?
Abstract (arXiv)
Novelty evaluation is vital for the promotion and management of innovation. With the advancement of information techniques and the open data movement, some progress has been made in novelty measurements. Tracking and reviewing novelty measures provides a data-driven way to assess contributions, progress, and emerging directions in the science field. As academic papers serve as the primary medium for the dissemination, validation, and discussion of scientific knowledge, this review aims to offer a systematic analysis of novelty measurements for scientific papers. We began by comparing the differences between scientific novelty and four similar concepts, including originality, scientific innovation, creativity, and scientific breakthrough. Next, we reviewed the types of scientific novelty. Then, we classified existing novelty measures according to data types and reviewed the measures for each type. Subsequently, we surveyed the approaches employed in validating novelty measures and examined the current tools and datasets associated with these measures. Finally, we proposed several open issues for future studies.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 12 of its 74 references that are in the map. First posted on arXiv 29 Jan 2025.
Builds on
12 of 74 references.
References · 12
- 2013Tradition and Innovation in Scientists' Research Strategiescited by 26
- 2019The Diversity-Innovation Paradox in Sciencecited by 21
- 2024Can ChatGPT evaluate research quality?cited by 17
- 2015A review of the literature on citation impact indicatorscited by 14
- 2015Defining and identifying Sleeping Beauties in sciencecited by 11
- 2021New Directions in Science Emerge from Disconnection and Discordcited by 8
- 2019Do we measure novelty when we analyze unusual combinations of cited references? A validation study of bibliometric novelty indicators based on F1000Prime datacited by 7
- 2018Creativity in Science and the Link to Cited References: Is the Creative Potential of Papers Reflected in their Cited References?cited by 6
- 2020Pandemics are catalysts of scientific novelty: Evidence from COVID-19cited by 6
- 2020Technological impact of biomedical research: the role of basicness and noveltycited by 2
- 2021Is Coronavirus-Related Research Becoming More Interdisciplinary? A Perspective of Co-occurrence Analysis and Diversity Measure of Scientific Articlescited by 2
- 2022Novelpy: A Python package to measure novelty and disruptiveness of bibliometric and patent datacited by 1
Built on by
Citing papers per year: 2025: 3; 2026: 9.
12 papers.
- 2026DeepReviewer 2.0: A Traceable Agentic System for Auditable Scientific Peer Reviewcited by 7
- 2026NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessmentcited by 7
- 2025Harnessing Large Language Models for Scientific Novelty Detectioncited by 6
- 2025Large Language Models for History, Philosophy, and Sociology of Science: Interpretive Uses, Methodological Challenges, and Critical Perspectivescited by 2
- 2025Mapping the Evolution of Research Contributions using KnoVocited by 2
- 2026Capability-Aware Early-Stage Research Idea Evaluationcited by 1
- 2026Are We Truly Innovating? A Qualitative and Quantitative Study of Originality in AI Research Paperscited by 1
- 2026An Axiomatic Benchmark for Evaluation of Scientific Novelty Metricscited by 1
- 2026Is It Novel and Why? Fine-Grained Patent Novelty Prediction Based on Passage Retrievalcited by 1
- 2026sciwrite-lint: Verification Infrastructure for the Age of Science Vibe-Writingcited by 0
- 2026Examining the Cognitive Gap Between Authors and Peer Reviewers on Academic Paper Noveltycited by 0
- 2026Measuring the Novelty of Biomedical Papers Using the Latent Distances between Knowledge Unitscited by 0
- 2026Measuring the Novelty of Biomedical Papers Using the Latent Distances between Knowledge Units4 Sep 2026
- 2026Examining the Cognitive Gap Between Authors and Peer Reviewers on Academic Paper Novelty11 Jun 2026
- 2026Is It Novel and Why? Fine-Grained Patent Novelty Prediction Based on Passage Retrieval4 May 2026
- 2026An Axiomatic Benchmark for Evaluation of Scientific Novelty Metrics16 Apr 2026
- 2026NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment13 Apr 2026
- 2026sciwrite-lint: Verification Infrastructure for the Age of Science Vibe-Writing9 Apr 2026
- 2026DeepReviewer 2.0: A Traceable Agentic System for Auditable Scientific Peer Review3 Mar 2026
- 2026Capability-Aware Early-Stage Research Idea Evaluation18 Jan 2026
- 2026Are We Truly Innovating? A Qualitative and Quantitative Study of Originality in AI Research Papers14 Jan 2026
- 2025Mapping the Evolution of Research Contributions using KnoVo20 Jun 2025
- 2025Large Language Models for History, Philosophy, and Sociology of Science: Interpretive Uses, Methodological Challenges, and Critical Perspectives13 Jun 2025
- 2025Harnessing Large Language Models for Scientific Novelty Detection30 May 2025