mlsanityData to 7 Oct 2026

From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systems

arXiv 2503.01424 ↗First posted 3 Mar 2025cs.AI cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

Research is a fundamental process driving the advancement of human civilization, yet it demands substantial time and effort from researchers. In recent years, the rapid development of artificial intelligence (AI) technologies has inspired researchers to explore how AI can accelerate and enhance research. To monitor relevant advancements, this paper presents a systematic review of the progress in this domain. Specifically, we organize the relevant studies into three main categories: hypothesis formulation, hypothesis validation, and manuscript publication. Hypothesis formulation involves knowledge synthesis and hypothesis generation. Hypothesis validation includes the verification of scientific claims, theorem proving, and experiment validation. Manuscript publication encompasses manuscript writing and the peer review process. Furthermore, we identify and discuss the current challenges faced in these areas, as well as potential future directions for research. Finally, we also offer a comprehensive overview of existing benchmarks and tools across various domains that support the integration of AI into the research process. We hope this paper serves as an introduction for beginners and fosters future research. Resources have been made publicly available at https://github.com/zkzhou126/AI-for-Research.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 163 of its 293 references that are in the map. First posted on arXiv 3 Mar 2025.

Builds on

163 of 293 references.

References · 163

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  3. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
  4. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
  5. 2020Knowledge Graphscited by 619
  6. 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
  7. 2023Enabling Large Language Models to Generate Text with Citationscited by 584
  8. 2020Fact or Fiction: Verifying Scientific Claimscited by 546
  9. 2023Are Emergent Abilities of Large Language Models a Mirage?cited by 515
  10. 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 405
  11. 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 380
  12. 2020Generative Language Modeling for Automated Theorem Provingcited by 379
38 more
  1. 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 348
  2. 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 339
  3. 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 278
  4. 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 225
  5. 2023Can large language models provide useful feedback on research papers? A large-scale empirical analysiscited by 195
  6. 2022HyperTree Proof Search for Neural Theorem Provingcited by 192
  7. 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 174
  8. 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviewscited by 160
  9. 2023Fact-Checking Complex Claims with Program-Guided Reasoningcited by 146
  10. 2024CycleResearcher: Improving Automated Research via Automated Reviewcited by 142
  11. 2023TaskBench: Benchmarking Large Language Models for Task Automationcited by 138
  12. 2024LAB-Bench: Measuring Capabilities of Language Models for Biology Researchcited by 138
  13. 2018A Dataset of Peer Reviews (PeerRead): Collection, Insights and NLP Applicationscited by 135
  14. 2020Generating Fact Checking Explanationscited by 132
  15. 2024Language agents achieve superhuman synthesis of scientific knowledgecited by 121
  16. 2023ReviewerGPT? An Exploratory Study on Using Large Language Models for Paper Reviewingcited by 118
  17. 2024AutoSurvey: Large Language Models Can Automatically Write Surveyscited by 116
  18. 2024CORE-Bench: Fostering the Credibility of Published Research Through a Computational Reproducibility Agent Benchmarkcited by 115
  19. 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4cited by 112
  20. 2024Mapping the Increasing Use of LLMs in Scientific Paperscited by 112
  21. 2023LEGO-Prover: Neural Theorem Proving with Growing Librariescited by 108
  22. 2019Learning to Prove Theorems via Interacting with Proof Assistantscited by 107
  23. 2023Large Language Models for Automated Open-domain Scientific Hypotheses Discoverycited by 100
  24. 2024MARG: Multi-Agent Review Generation for Scientific Paperscited by 98
  25. 2022Thor: Wielding Hammers to Integrate Language Models and Automated Theorem Proverscited by 97
  26. 2023Towards LLM-based Fact Verification on News Claims with a Hierarchical Step-by-Step Prompting Methodcited by 97
  27. 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discoverycited by 96
  28. 2022SciFact-Open: Towards open-domain scientific claim verificationcited by 94
  29. 2024Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agentscited by 94
  30. 2024SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoningcited by 90
  31. 2024DISCOVERYWORLD: A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agentscited by 89
  32. 2024LLM and Simulation as Bilevel Optimizers: A New Paradigm to Advance Physical Scientific Discoverycited by 82
  33. 2025LLM4SR: A Survey on Large Language Models for Scientific Researchcited by 81
  34. 2023AutoML-GPT: Automatic Machine Learning with GPTcited by 80
  35. 2023An In-Context Learning Agent for Formal Theorem-Provingcited by 78
  36. 2024From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agentscited by 76
  37. 2019ScisummNet: A Large Annotated Corpus and Content-Impact Models for Scientific Paper Summarization with Citation Networkscited by 73
  38. 2023MLCopilot: Unleashing the Power of Large Language Models in Solving Machine Learning Taskscited by 66

50 most cited of 163 All 163 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 7; 2026: 1.

8 papers.

  1. 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 74
  2. 2025How Far Are AI Scientists from Changing the World?cited by 15
  3. 2025AutoLabs: Cognitive Multi-Agent Systems with Self-Correction for Autonomous Chemical Experimentationcited by 13
  4. 2025Evolving Roles of LLMs in Scientific Innovation: Assistant, Collaborator, Scientist, and Evaluatorcited by 9
  5. 2025XtraGPT: Context-Aware and Controllable Academic Paper Revision via Human-AI Collaborationcited by 6
  6. 2025AutoPR: Let's Automate Your Academic Promotion!cited by 2
  7. 2026Can AI Review Improve Paper Drafting? An Empirical Study on 20 Computer Architecture Submissionscited by 2
  8. 2025HypoChainer: A Collaborative System Combining LLMs and Knowledge Graphs for Hypothesis-Driven Scientific Discoverycited by 1