mlsanityData to 14 Oct 2026

Autonomous LLM-driven research from data to human-verifiable research papers

arXiv 2404.17605 ↗First posted 24 Apr 2024q-bio.OT cs.AIcited by 53

Not on the map. Why?

Cited by 22 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

As AI promises to accelerate scientific discovery, it remains unclear whether fully AI-driven research is possible and whether it can adhere to key scientific values, such as transparency, traceability and verifiability. Mimicking human scientific practices, we built data-to-paper, an automation platform that guides interacting LLM agents through a complete stepwise research process, while programmatically back-tracing information flow and allowing human oversight and interactions. In autopilot mode, provided with annotated data alone, data-to-paper raised hypotheses, designed research plans, wrote and debugged analysis codes, generated and interpreted results, and created complete and information-traceable research papers. Even though research novelty was relatively limited, the process demonstrated autonomous generation of de novo quantitative insights from data. For simple research goals, a fully-autonomous cycle can create manuscripts which recapitulate peer-reviewed publications without major errors in about 80-90%, yet as goal complexity increases, human co-piloting becomes critical for assuring accuracy. Beyond the process itself, created manuscripts too are inherently verifiable, as information-tracing allows to programmatically chain results, methods and data. Our work thereby demonstrates a potential for AI-driven acceleration of scientific discovery while enhancing, rather than jeopardizing, traceability, transparency and verifiability.

Key facts. Cited by 53 papers in the map (data through 14 Oct 2026). Builds on 23 of its 54 references that are in the map. First posted on arXiv 24 Apr 2024.

Builds on

23 of 54 references.

References · 23

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  2. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  3. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  4. 2023Code Llama: Open Foundation Models for Codecited by 2,139
  5. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
  6. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  7. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  8. 2022Competition-Level Code Generation with AlphaCodecited by 1,462
  9. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
  10. 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 430
  11. 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 353
  12. 2023Self-collaboration Code Generation via ChatGPTcited by 258
11 more
  1. 2023Can large language models provide useful feedback on research papers? A large-scale empirical analysiscited by 200
  2. 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 179
  3. 2023Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Modelscited by 154
  4. 2020TLDR: Extreme Summarization of Scientific Documentscited by 136
  5. 2023Solving Math Word Problems by Combining Language Models With Symbolic Solverscited by 124
  6. 2023The Semantic Scholar Open Data Platformcited by 118
  7. 2023RecurrentGPT: Interactive Generation of (Arbitrarily) Long Textcited by 84
  8. 2024Towards Conversational Diagnostic AIcited by 79
  9. 2023AI model GPT-3 (dis)informs us better than humanscited by 78
  10. 2023DERA: Enhancing Large Language Model Completions with Dialog-Enabled Resolving Agentscited by 52
  11. 2024Data-driven Discovery with Large Generative Modelscited by 34

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 26; 2026: 25.

53 papers.

Sort:

By area:

  1. 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 425
  2. 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 363
  3. 2026Towards End-to-End Automation of AI Researchcited by 159
  4. 2025Memp: Exploring Agent Procedural Memorycited by 103
  5. 2025AgentRxiv: Towards Collaborative Autonomous Researchcited by 72
  6. 2025Robin: A multi-agent system for automating scientific discoverycited by 62
  7. 2025Automated Hypothesis Validation with Agentic Sequential Falsificationscited by 44
  8. 2025EXP-Bench: Can AI Conduct AI Research Experiments?cited by 37
  9. 2025LMR-BENCH: Evaluating LLM Agent's Ability on Reproducing Language Modeling Researchcited by 29
  10. 2026ARIS: Autonomous Research via Adversarial Multi-Agent Collaborationcited by 16
  11. 2025ORFS-agent: Tool-Using Agents for Chip Design Optimizationcited by 14
  12. 2026AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discoverycited by 10
38 more
  1. 2025Toward Reliable Scientific Hypothesis Generation: Evaluating Truthfulness and Hallucination in Large Language Modelscited by 9
  2. 2025Evolving Roles of LLMs in Scientific Innovation: Assistant, Collaborator, Scientist, and Evaluatorcited by 9
  3. 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 9
  4. 2025From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systemscited by 8
  5. 2025TinyScientist: An Interactive, Extensible, and Controllable Framework for Building Research Agentscited by 8
  6. 2024Creativity in AI: Progresses and Challengescited by 7
  7. 2025XtraGPT: Context-Aware and Controllable Academic Paper Revision via Human-AI Collaborationcited by 7
  8. 2025An evaluation of DeepSeek Models in Biomedical Natural Language Processingcited by 6
  9. 2026MadEvolve: Evolutionary Optimization of Cosmological Algorithms with Large Language Modelscited by 6
  10. 2026The Story is Not the Science: Execution-Grounded Evaluation of Mechanistic Interpretability Researchcited by 6
  11. 2026GoodPoint: Learning Constructive Scientific Paper Feedback from Author Responsescited by 4
  12. 2025Reimagining Urban Science: Scaling Causal Inference with Large Language Modelscited by 3
  13. 2025OpenLens AI: Fully Autonomous Research Agent for Health Infomaticscited by 3
  14. 2025GenCellAgent: Generalizable, Training-Free Cellular Image Segmentation via Large Language Model Agentscited by 3
  15. 2026ResearchLoop: An Evidence-Gated Control Plane for AI-Assisted Researchcited by 3
  16. 2025Enabling Inclusive Systematic Reviews: Incorporating Preprint Articles with Large Language Model-Driven Evaluationscited by 2
  17. 2025Does GenAI Rewrite How We Write? An Empirical Study on Two-Million Preprintscited by 2
  18. 2026DeepXiv-SDK: An Agentic Data Interface for Scientific Literaturecited by 2
  19. 2026pAI/MSc: ML Theory Research with Humans on the Loopcited by 2
  20. 2026Towards Autonomous and Auditable Medical Imaging Model Developmentcited by 2
  21. 2025Towards Automated Scoping of AI for Social Good Projectscited by 1
  22. 2025Large Language Model-Based Agents for Automated Research Reproducibility: An Exploratory Study in Alzheimer's Diseasecited by 1
  23. 2025The Budget AI Researcher and the Power of RAG Chainscited by 1
  24. 2025GUIDE: Towards Scalable Advising for Research Ideascited by 1
  25. 2025Why can't Epidemiology be automated (yet)?cited by 1
  26. 2025From AutoRecSys to AutoRecLab: A Call to Build, Evaluate, and Govern Autonomous Recommender-Systems Research Labscited by 1
  27. 2025HybridQuestion: Human-AI Collaboration for Identifying High-Impact Research Questionscited by 1
  28. 2026The Emerging AI Paper-Review Arms Race: Adversarial Co-Evolution in Scholarly Publishingcited by 1
  29. 2026Conversational AI for Rapid Scientific Prototyping: A Case Study on ESA's ELOPE Competitioncited by 0
  30. 2026Deep probabilistic model synthesis enables unified modeling of whole-brain neural activity across individual subjectscited by 0
  31. 2026Questionnaire Responses Do not Capture the Safety of AI Agentscited by 0
  32. 2026Agentic evolution of physically constrained foundation modelscited by 0
  33. 2026SciForge: An AI-Native, Multimodal Workbench for Scientific Discoverycited by 0
  34. 2026pAI-Econ-claude: A Gated Human-in-the-Loop Multi-Agent Architecture for AI-Assisted Economic Theory Developmentcited by 0
  35. 2026WARA: Toward Automated Wireless Optimization Research with Closed-Loop LLM Agentscited by 0
  36. 2026Position: AI Agents in Scientific Teams Should Be Studied as Human-Agent Systemscited by 0
  37. 2026Learning to Evaluate Before Improving: Automatic Rubric Induction for Automatic Research Agentscited by 0
  38. 2026AutoRecLab: Describe the Experiment, Get the Code!cited by 0

50 most cited of 53 All 53 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2026Why LLMs Aren't Scientists Yet: Lessons from Four Autonomous Research Attempts
  2. 2025A Vision for Auto Research with LLM Agents
  3. 2025AI-Researcher: Autonomous Scientific Innovation
  4. 2026PARNESS: A Paper Harness for End-to-End Automated Scientific Research with Dynamic Workflows, Full-Text Indexing, and Cross-Run Knowledge Accumulation
  5. 2026AutoResearchClaw: Self-Reinforcing Autonomous Research with Human-AI Collaboration
  6. 2026ResearchClawBench: A Benchmark for End-to-End Autonomous Scientific Research
  7. 2026Towards a Medical AI Scientist
  8. 2026ScientistOne: Towards Human-Level Autonomous Research via Chain-of-Evidence