GraphMind: Interactive Novelty Assessment System for Accelerating Scientific Discovery
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
Abstract (arXiv)
Large Language Models (LLMs) show strong reasoning and text generation capabilities, prompting their use in scientific literature analysis, including novelty assessment. While evaluating novelty of scientific papers is crucial for peer review, it requires extensive knowledge of related work, something not all reviewers have. While recent work on LLM-assisted scientific literature analysis supports literature comparison, existing approaches offer limited transparency and lack mechanisms for result traceability via an information retrieval module. To address this gap, we introduce GraphMind, an easy-to-use interactive web tool designed to assist users in evaluating the novelty of scientific papers or drafted ideas. Specially, GraphMind enables users to capture the main structure of a scientific paper, explore related ideas through various perspectives, and assess novelty via providing verifiable contextual insights. GraphMind enables users to annotate key elements of a paper, explore related papers through various relationships, and assess novelty with contextual insight. This tool integrates external APIs such as arXiv and Semantic Scholar with LLMs to support annotation, extraction, retrieval and classification of papers. This combination provides users with a rich, structured view of a scientific idea's core contributions and its connections to existing work. GraphMind is available at https://oyarsa.github.io/graphmind and a demonstration video at https://youtu.be/wKbjQpSvwJg. The source code is available at https://github.com/oyarsa/graphmind.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 8 of its 17 references that are in the map. First posted on arXiv 17 Oct 2025.
Builds on
8 of 17 references.
References · 8
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2018A Dataset of Peer Reviews (PeerRead): Collection, Insights and NLP Applicationscited by 135
- 2022SciRepEval: A Multi-Format Benchmark for Scientific Document Representationscited by 124
- 2021Can We Automate Scientific Reviewing?cited by 63
- 2024Evaluating and Enhancing Large Language Models for Novelty Assessment in Scholarly Publicationscited by 26
- 2022Scientific Paper Recommendation Systems: a Literature Review of recent Publicationscited by 10
- 2024NovAScore: A New Automated Metric for Evaluating Document Level Noveltycited by 4
- 2025Scholar Inbox: Personalized Paper Recommendations for Scientistscited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessmentcited by 6
- 2026OpenNovelty: An LLM-powered Agentic System for Verifiable Scholarly Novelty Assessmentcited by 4
- 2026MemoNoveltyAgent: A Historical Research Memory-Aware Agent Workflow for Paper Novelty Assessmentcited by 1
- 2026Do Methods Support the Claims? Intra-Paper Verification for Peer Reviewcited by 1
- 2026Do Methods Support the Claims? Intra-Paper Verification for Peer Review21 Jun 2026
- 2026NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment13 Apr 2026
- 2026MemoNoveltyAgent: A Historical Research Memory-Aware Agent Workflow for Paper Novelty Assessment21 Mar 2026
- 2026OpenNovelty: An LLM-powered Agentic System for Verifiable Scholarly Novelty Assessment4 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025Literature-Grounded Novelty Assessment of Scientific Ideas
- 2026Is this Idea Novel? An Automated Benchmark for Judgment of Research Ideas
- 2025NoveltyRank: A Retrieval-Augmented Framework for Conceptual Novelty Estimation in AI Research
- 2026Graph2Idea:Retrieval-Augmented Scientific Idea Generation with Graph-Structured Contexts
- 2026Think-Probe-Respond: Improving Large Language Models as Judges of Research Idea Novelty
- 2025Beyond "Not Novel Enough": Enriching Scholarly Critique with LLM-Assisted Feedback
- 2026PaperMind: Benchmarking Agentic Reasoning and Critique over Scientific Papers in Multimodal LLMs
- 2025Graph Your Way to Inspiration: Integrating Co-Author Graphs with Retrieval-Augmented Generation for Large Language Model Based Scientific Idea Generation