Autonomous LLM-driven research from data to human-verifiable research papers
Not on the map. Why?
Cited by 22 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
As AI promises to accelerate scientific discovery, it remains unclear whether fully AI-driven research is possible and whether it can adhere to key scientific values, such as transparency, traceability and verifiability. Mimicking human scientific practices, we built data-to-paper, an automation platform that guides interacting LLM agents through a complete stepwise research process, while programmatically back-tracing information flow and allowing human oversight and interactions. In autopilot mode, provided with annotated data alone, data-to-paper raised hypotheses, designed research plans, wrote and debugged analysis codes, generated and interpreted results, and created complete and information-traceable research papers. Even though research novelty was relatively limited, the process demonstrated autonomous generation of de novo quantitative insights from data. For simple research goals, a fully-autonomous cycle can create manuscripts which recapitulate peer-reviewed publications without major errors in about 80-90%, yet as goal complexity increases, human co-piloting becomes critical for assuring accuracy. Beyond the process itself, created manuscripts too are inherently verifiable, as information-tracing allows to programmatically chain results, methods and data. Our work thereby demonstrates a potential for AI-driven acceleration of scientific discovery while enhancing, rather than jeopardizing, traceability, transparency and verifiability.
Key facts. Cited by 53 papers in the map (data through 14 Oct 2026). Builds on 23 of its 54 references that are in the map. First posted on arXiv 24 Apr 2024.
Builds on
23 of 54 references.
References · 23
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2023Code Llama: Open Foundation Models for Codecited by 2,139
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2022Competition-Level Code Generation with AlphaCodecited by 1,462
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 430
- 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 353
- 2023Self-collaboration Code Generation via ChatGPTcited by 258
11 more
- 2023Can large language models provide useful feedback on research papers? A large-scale empirical analysiscited by 200
- 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 179
- 2023Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Modelscited by 154
- 2020TLDR: Extreme Summarization of Scientific Documentscited by 136
- 2023Solving Math Word Problems by Combining Language Models With Symbolic Solverscited by 124
- 2023The Semantic Scholar Open Data Platformcited by 118
- 2023RecurrentGPT: Interactive Generation of (Arbitrarily) Long Textcited by 84
- 2024Towards Conversational Diagnostic AIcited by 79
- 2023AI model GPT-3 (dis)informs us better than humanscited by 78
- 2023DERA: Enhancing Large Language Model Completions with Dialog-Enabled Resolving Agentscited by 52
- 2024Data-driven Discovery with Large Generative Modelscited by 34
Built on by
Citing papers per year: 2024: 2; 2025: 26; 2026: 25.
53 papers.
Sort:
By area:
- 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 425
- 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 363
- 2026Towards End-to-End Automation of AI Researchcited by 159
- 2025Memp: Exploring Agent Procedural Memorycited by 103
- 2025AgentRxiv: Towards Collaborative Autonomous Researchcited by 72
- 2025Robin: A multi-agent system for automating scientific discoverycited by 62
- 2025Automated Hypothesis Validation with Agentic Sequential Falsificationscited by 44
- 2025EXP-Bench: Can AI Conduct AI Research Experiments?cited by 37
- 2025LMR-BENCH: Evaluating LLM Agent's Ability on Reproducing Language Modeling Researchcited by 29
- 2026ARIS: Autonomous Research via Adversarial Multi-Agent Collaborationcited by 16
- 2025ORFS-agent: Tool-Using Agents for Chip Design Optimizationcited by 14
- 2026AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discoverycited by 10
38 more
- 2025Toward Reliable Scientific Hypothesis Generation: Evaluating Truthfulness and Hallucination in Large Language Modelscited by 9
- 2025Evolving Roles of LLMs in Scientific Innovation: Assistant, Collaborator, Scientist, and Evaluatorcited by 9
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 9
- 2025From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systemscited by 8
- 2025TinyScientist: An Interactive, Extensible, and Controllable Framework for Building Research Agentscited by 8
- 2024Creativity in AI: Progresses and Challengescited by 7
- 2025XtraGPT: Context-Aware and Controllable Academic Paper Revision via Human-AI Collaborationcited by 7
- 2025An evaluation of DeepSeek Models in Biomedical Natural Language Processingcited by 6
- 2026MadEvolve: Evolutionary Optimization of Cosmological Algorithms with Large Language Modelscited by 6
- 2026The Story is Not the Science: Execution-Grounded Evaluation of Mechanistic Interpretability Researchcited by 6
- 2026GoodPoint: Learning Constructive Scientific Paper Feedback from Author Responsescited by 4
- 2025Reimagining Urban Science: Scaling Causal Inference with Large Language Modelscited by 3
- 2025OpenLens AI: Fully Autonomous Research Agent for Health Infomaticscited by 3
- 2025GenCellAgent: Generalizable, Training-Free Cellular Image Segmentation via Large Language Model Agentscited by 3
- 2026ResearchLoop: An Evidence-Gated Control Plane for AI-Assisted Researchcited by 3
- 2025Enabling Inclusive Systematic Reviews: Incorporating Preprint Articles with Large Language Model-Driven Evaluationscited by 2
- 2025Does GenAI Rewrite How We Write? An Empirical Study on Two-Million Preprintscited by 2
- 2026DeepXiv-SDK: An Agentic Data Interface for Scientific Literaturecited by 2
- 2026pAI/MSc: ML Theory Research with Humans on the Loopcited by 2
- 2026Towards Autonomous and Auditable Medical Imaging Model Developmentcited by 2
- 2025Towards Automated Scoping of AI for Social Good Projectscited by 1
- 2025Large Language Model-Based Agents for Automated Research Reproducibility: An Exploratory Study in Alzheimer's Diseasecited by 1
- 2025The Budget AI Researcher and the Power of RAG Chainscited by 1
- 2025GUIDE: Towards Scalable Advising for Research Ideascited by 1
- 2025Why can't Epidemiology be automated (yet)?cited by 1
- 2025From AutoRecSys to AutoRecLab: A Call to Build, Evaluate, and Govern Autonomous Recommender-Systems Research Labscited by 1
- 2025HybridQuestion: Human-AI Collaboration for Identifying High-Impact Research Questionscited by 1
- 2026The Emerging AI Paper-Review Arms Race: Adversarial Co-Evolution in Scholarly Publishingcited by 1
- 2026Conversational AI for Rapid Scientific Prototyping: A Case Study on ESA's ELOPE Competitioncited by 0
- 2026Deep probabilistic model synthesis enables unified modeling of whole-brain neural activity across individual subjectscited by 0
- 2026Questionnaire Responses Do not Capture the Safety of AI Agentscited by 0
- 2026Agentic evolution of physically constrained foundation modelscited by 0
- 2026SciForge: An AI-Native, Multimodal Workbench for Scientific Discoverycited by 0
- 2026pAI-Econ-claude: A Gated Human-in-the-Loop Multi-Agent Architecture for AI-Assisted Economic Theory Developmentcited by 0
- 2026WARA: Toward Automated Wireless Optimization Research with Closed-Loop LLM Agentscited by 0
- 2026Position: AI Agents in Scientific Teams Should Be Studied as Human-Agent Systemscited by 0
- 2026Learning to Evaluate Before Improving: Automatic Rubric Induction for Automatic Research Agentscited by 0
- 2026AutoRecLab: Describe the Experiment, Get the Code!cited by 0
50 most cited of 53 All 53 (JSON)
- 2026Large Language Models, Machine-Assisted Cultural Analytics, and the Agentic Turn8 Oct 2026
- 2026CircuitATLAS: Agentic reasoning over a systems neuroscience knowledge graph for target discovery in circuitopathies7 Oct 2026
- 2026IdeaScientist: Orchestrating Agents for Grounded Scientific Ideation2 Oct 2026
- 2026AutoRecLab: Describe the Experiment, Get the Code!18 Sep 2026
- 2026The Emerging AI Paper-Review Arms Race: Adversarial Co-Evolution in Scholarly Publishing7 Sep 2026
- 2026Learning to Evaluate Before Improving: Automatic Rubric Induction for Automatic Research Agents31 Aug 2026
- 2026Position: AI Agents in Scientific Teams Should Be Studied as Human-Agent Systems2 Aug 2026
- 2026pAI-Econ-claude: A Gated Human-in-the-Loop Multi-Agent Architecture for AI-Assisted Economic Theory Development23 Jul 2026
- 2026SciForge: An AI-Native, Multimodal Workbench for Scientific Discovery17 Jul 2026
- 2026Towards Autonomous and Auditable Medical Imaging Model Development12 Jul 2026
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gap29 Jun 2026
- 2026Agentic evolution of physically constrained foundation models24 Jun 2026
38 more
- 2026WARA: Toward Automated Wireless Optimization Research with Closed-Loop LLM Agents7 Jun 2026
- 2026ResearchLoop: An Evidence-Gated Control Plane for AI-Assisted Research27 May 2026
- 2026AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discovery22 May 2026
- 2026ARIS: Autonomous Research via Adversarial Multi-Agent Collaboration4 May 2026
- 2026pAI/MSc: ML Theory Research with Humans on the Loop22 Apr 2026
- 2026GoodPoint: Learning Constructive Scientific Paper Feedback from Author Responses13 Apr 2026
- 2026Towards End-to-End Automation of AI Research31 Mar 2026
- 2026Questionnaire Responses Do not Capture the Safety of AI Agents15 Mar 2026
- 2026Deep probabilistic model synthesis enables unified modeling of whole-brain neural activity across individual subjects15 Mar 2026
- 2026MadEvolve: Evolutionary Optimization of Cosmological Algorithms with Large Language Models17 Feb 2026
- 2026DeepXiv-SDK: An Agentic Data Interface for Scientific Literature14 Feb 2026
- 2026The Story is Not the Science: Execution-Grounded Evaluation of Mechanistic Interpretability Research5 Feb 2026
- 2026Conversational AI for Rapid Scientific Prototyping: A Case Study on ESA's ELOPE Competition8 Jan 2026
- 2025HybridQuestion: Human-AI Collaboration for Identifying High-Impact Research Questions18 Dec 2025
- 2025From AutoRecSys to AutoRecLab: A Call to Build, Evaluate, and Govern Autonomous Recommender-Systems Research Labs20 Oct 2025
- 2025Does GenAI Rewrite How We Write? An Empirical Study on Two-Million Preprints18 Oct 2025
- 2025GenCellAgent: Generalizable, Training-Free Cellular Image Segmentation via Large Language Model Agents14 Oct 2025
- 2025TinyScientist: An Interactive, Extensible, and Controllable Framework for Building Research Agents8 Oct 2025
- 2025OpenLens AI: Fully Autonomous Research Agent for Health Infomatics18 Sep 2025
- 2025Memp: Exploring Agent Procedural Memory8 Aug 2025
- 2025Why can't Epidemiology be automated (yet)?21 Jul 2025
- 2025Evolving Roles of LLMs in Scientific Innovation: Assistant, Collaborator, Scientist, and Evaluator16 Jul 2025
- 2025GUIDE: Towards Scalable Advising for Research Ideas9 Jul 2025
- 2025LMR-BENCH: Evaluating LLM Agent's Ability on Reproducing Language Modeling Research19 Jun 2025
- 2025The Budget AI Researcher and the Power of RAG Chains14 Jun 2025
- 2025ORFS-agent: Tool-Using Agents for Chip Design Optimization10 Jun 2025
- 2025EXP-Bench: Can AI Conduct AI Research Experiments?30 May 2025
- 2025Large Language Model-Based Agents for Automated Research Reproducibility: An Exploratory Study in Alzheimer's Disease29 May 2025
- 2025Toward Reliable Scientific Hypothesis Generation: Evaluating Truthfulness and Hallucination in Large Language Models20 May 2025
- 2025Robin: A multi-agent system for automating scientific discovery19 May 2025
- 2025XtraGPT: Context-Aware and Controllable Academic Paper Revision via Human-AI Collaboration16 May 2025
- 2025Towards Automated Scoping of AI for Social Good Projects28 Apr 2025
- 2025Reimagining Urban Science: Scaling Causal Inference with Large Language Models15 Apr 2025
- 2025AgentRxiv: Towards Collaborative Autonomous Research23 Mar 2025
- 2025Enabling Inclusive Systematic Reviews: Incorporating Preprint Articles with Large Language Model-Driven Evaluations18 Mar 2025
- 2025From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systems3 Mar 2025
- 2025An evaluation of DeepSeek Models in Biomedical Natural Language Processing1 Mar 2025
- 2025Automated Hypothesis Validation with Agentic Sequential Falsifications14 Feb 2025
50 newest of 53 All 53 (JSON)
- 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 425
- 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 363
- 2025Memp: Exploring Agent Procedural Memorycited by 103
- 2025Automated Hypothesis Validation with Agentic Sequential Falsificationscited by 44
- 2025LMR-BENCH: Evaluating LLM Agent's Ability on Reproducing Language Modeling Researchcited by 29
- 2026ARIS: Autonomous Research via Adversarial Multi-Agent Collaborationcited by 16
- 2025ORFS-agent: Tool-Using Agents for Chip Design Optimizationcited by 14
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 9
- 2025TinyScientist: An Interactive, Extensible, and Controllable Framework for Building Research Agentscited by 8
- 2025OpenLens AI: Fully Autonomous Research Agent for Health Infomaticscited by 3
- 2026DeepXiv-SDK: An Agentic Data Interface for Scientific Literaturecited by 2
- 2025Large Language Model-Based Agents for Automated Research Reproducibility: An Exploratory Study in Alzheimer's Diseasecited by 1
12 most cited of 21 All 21 (JSON)
- 2026Large Language Models, Machine-Assisted Cultural Analytics, and the Agentic Turn8 Oct 2026
- 2026IdeaScientist: Orchestrating Agents for Grounded Scientific Ideation2 Oct 2026
- 2026The Emerging AI Paper-Review Arms Race: Adversarial Co-Evolution in Scholarly Publishing7 Sep 2026
- 2026Learning to Evaluate Before Improving: Automatic Rubric Induction for Automatic Research Agents31 Aug 2026
- 2026Position: AI Agents in Scientific Teams Should Be Studied as Human-Agent Systems2 Aug 2026
- 2026pAI-Econ-claude: A Gated Human-in-the-Loop Multi-Agent Architecture for AI-Assisted Economic Theory Development23 Jul 2026
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gap29 Jun 2026
- 2026Agentic evolution of physically constrained foundation models24 Jun 2026
- 2026WARA: Toward Automated Wireless Optimization Research with Closed-Loop LLM Agents7 Jun 2026
- 2026ARIS: Autonomous Research via Adversarial Multi-Agent Collaboration4 May 2026
- 2026Questionnaire Responses Do not Capture the Safety of AI Agents15 Mar 2026
- 2026DeepXiv-SDK: An Agentic Data Interface for Scientific Literature14 Feb 2026
12 newest of 21 All 21 (JSON)
- 2026Towards End-to-End Automation of AI Researchcited by 159
- 2025AgentRxiv: Towards Collaborative Autonomous Researchcited by 72
- 2025Robin: A multi-agent system for automating scientific discoverycited by 62
- 2025EXP-Bench: Can AI Conduct AI Research Experiments?cited by 37
- 2026AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discoverycited by 10
- 2025Toward Reliable Scientific Hypothesis Generation: Evaluating Truthfulness and Hallucination in Large Language Modelscited by 9
- 2025Evolving Roles of LLMs in Scientific Innovation: Assistant, Collaborator, Scientist, and Evaluatorcited by 9
- 2025From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systemscited by 8
- 2024Creativity in AI: Progresses and Challengescited by 7
- 2025XtraGPT: Context-Aware and Controllable Academic Paper Revision via Human-AI Collaborationcited by 7
- 2025An evaluation of DeepSeek Models in Biomedical Natural Language Processingcited by 6
- 2026MadEvolve: Evolutionary Optimization of Cosmological Algorithms with Large Language Modelscited by 6
12 most cited of 29 All 29 (JSON)
- 2026AutoRecLab: Describe the Experiment, Get the Code!18 Sep 2026
- 2026SciForge: An AI-Native, Multimodal Workbench for Scientific Discovery17 Jul 2026
- 2026Towards Autonomous and Auditable Medical Imaging Model Development12 Jul 2026
- 2026ResearchLoop: An Evidence-Gated Control Plane for AI-Assisted Research27 May 2026
- 2026AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discovery22 May 2026
- 2026pAI/MSc: ML Theory Research with Humans on the Loop22 Apr 2026
- 2026Towards End-to-End Automation of AI Research31 Mar 2026
- 2026Deep probabilistic model synthesis enables unified modeling of whole-brain neural activity across individual subjects15 Mar 2026
- 2026MadEvolve: Evolutionary Optimization of Cosmological Algorithms with Large Language Models17 Feb 2026
- 2026Conversational AI for Rapid Scientific Prototyping: A Case Study on ESA's ELOPE Competition8 Jan 2026
- 2025HybridQuestion: Human-AI Collaboration for Identifying High-Impact Research Questions18 Dec 2025
- 2025From AutoRecSys to AutoRecLab: A Call to Build, Evaluate, and Govern Autonomous Recommender-Systems Research Labs20 Oct 2025
12 newest of 29 All 29 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026Why LLMs Aren't Scientists Yet: Lessons from Four Autonomous Research Attempts
- 2025A Vision for Auto Research with LLM Agents
- 2025AI-Researcher: Autonomous Scientific Innovation
- 2026PARNESS: A Paper Harness for End-to-End Automated Scientific Research with Dynamic Workflows, Full-Text Indexing, and Cross-Run Knowledge Accumulation
- 2026AutoResearchClaw: Self-Reinforcing Autonomous Research with Human-AI Collaboration
- 2026ResearchClawBench: A Benchmark for End-to-End Autonomous Scientific Research
- 2026Towards a Medical AI Scientist
- 2026ScientistOne: Towards Human-Level Autonomous Research via Chain-of-Evidence