Navigating Ideation Space: Decomposed Conceptual Representations for Positioning Scientific Ideas
Not on the map. Why?
Abstract (arXiv)
Scientific discovery is a cumulative process and requires new ideas to be situated within an ever-expanding landscape of existing knowledge. An emerging and critical challenge is how to identify conceptually relevant prior work from rapidly growing literature, and assess how a new idea differentiates from existing research. Current embedding approaches typically conflate distinct conceptual aspects into single representations and cannot support fine-grained literature retrieval; meanwhile, LLM-based evaluators are subject to sycophancy biases, failing to provide discriminative novelty assessment. To tackle these challenges, we introduce the Ideation Space, a structured representation that decomposes scientific knowledge into three distinct dimensions, i.e., research problem, methodology, and core findings, each learned through contrastive training. This framework enables principled measurement of conceptual distance between ideas, and modeling of ideation transitions that capture the logical connections within a proposed idea. Building upon this representation, we propose a Hierarchical Sub-Space Retrieval framework for efficient, targeted literature retrieval, and a Decomposed Novelty Assessment algorithm that identifies which aspects of an idea are novel. Extensive experiments demonstrate substantial improvements, where our approach achieves Recall@30 of 0.329 (16.7% over baselines), our ideation transition retrieval reaches Hit Rate@30 of 0.643, and novelty assessment attains 0.37 correlation with expert judgments. In summary, our work provides a promising paradigm for future research on accelerating and evaluating scientific discovery.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 19 of its 33 references that are in the map. First posted on arXiv 13 Jan 2026.
Builds on
19 of 33 references.
References · 19
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
- 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
- 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
- 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 426
- 2024Justice or Prejudice? Quantifying Biases in LLM-as-a-Judgecited by 354
- 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 348
- 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 174
- 2022SciRepEval: A Multi-Format Benchmark for Scientific Document Representationscited by 124
- 2022Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddingscited by 75
7 more
- 2024Human-LLM Compound System for Scientific Ideation through Facet Recombination and Novelty Evaluationcited by 39
- 2023X-Eval: Generalizable Multi-aspect Text Evaluation via Augmented Instruction Tuning with Auxiliary Evaluation Aspectscited by 28
- 2024Holistic Evaluation for Interleaved Text-and-Image Generationcited by 26
- 2022Incremental Prompting: Episodic Memory Prompt for Lifelong Event Detectioncited by 23
- 2025GraphEval: A Lightweight Graph-Based LLM Framework for Idea Evaluationcited by 17
- 2023Teamwork Is Not Always Good: An Empirical Study of Classifier Drift in Class-incremental Information Extractioncited by 9
- 2024MetaScientist: A Human-AI Synergistic Framework for Automated Mechanical Metamaterial Designcited by 8
Built on by
Citing papers per year: 2026: 3.
3 papers.