mlsanityData to 7 Oct 2026

Speculative Exploration on the Concept of Artificial Agents Conducting Autonomous Research

arXiv 2312.03497 ↗First posted 6 Dec 2023cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

This paper engages in a speculative exploration of the concept of an artificial agent capable of conducting research. Initially, it examines how the act of research can be conceptually characterized, aiming to provide a starting point for discussions about what it means to create such agents. The focus then shifts to the core components of research: question formulation, hypothesis generation, and hypothesis verification. This discussion includes a consideration of the potential and challenges associated with enabling machines to autonomously perform these tasks. Subsequently, this paper briefly considers the overlapping themes and interconnections that underlie them. Finally, the paper presents preliminary thoughts on prototyping as an initial step towards uncovering the challenges involved in developing these research-capable agents.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 72 of its 155 references that are in the map. First posted on arXiv 6 Dec 2023.

Builds on

72 of 155 references.

References · 72

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2020Scaling Laws for Neural Language Modelscited by 6,411
  6. 2017On Calibration of Modern Neural Networkscited by 4,860
  7. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  8. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  9. 2023A Survey of Large Language Modelscited by 2,537
  10. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  11. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  12. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
38 more
  1. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
  2. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  3. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
  4. 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 895
  5. 2022Galactica: A Large Language Model for Sciencecited by 736
  6. 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 630
  7. 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
  8. 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 531
  9. 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 506
  10. 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 426
  11. 2023Llemma: An Open Language Model For Mathematicscited by 385
  12. 2021A Survey on Automated Fact-Checkingcited by 376
  13. 2023ClimaX: A foundation model for weather and climatecited by 325
  14. 2023Towards Generalist Biomedical AIcited by 286
  15. 2020Inductive Biases for Deep Learning of Higher-Level Cognitioncited by 273
  16. 2023Can Large Language Models Transform Computational Social Science?cited by 245
  17. 2023MathPrompter: Mathematical Reasoning using Large Language Modelscited by 236
  18. 2023Can large language models provide useful feedback on research papers? A large-scale empirical analysiscited by 195
  19. 2023What can Large Language Models do in chemistry? A comprehensive benchmark on eight taskscited by 179
  20. 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 174
  21. 2021Hyperparameter Optimization: Foundations, Algorithms, Best Practices and Open Challengescited by 143
  22. 2023Neural Architecture Search: Insights from 1000 Paperscited by 136
  23. 2022Machine Learning Operations (MLOps): Overview, Definition, and Architecturecited by 126
  24. 2023ReviewerGPT? An Exploratory Study on Using Large Language Models for Paper Reviewingcited by 118
  25. 2023Artificial Intelligence for Science in Quantum, Atomistic, and Continuum Systemscited by 118
  26. 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4cited by 112
  27. 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
  28. 202314 Examples of How LLMs Can Transform Materials Science and Chemistry: A Reflection on a Large Language Model Hackathoncited by 85
  29. 2021MatSciBERT: A Materials Domain Language Model for Text Mining and Information Extractioncited by 82
  30. 2023AutoML-GPT: Automatic Machine Learning with GPTcited by 80
  31. 2019A survey on intrinsic motivation in reinforcement learningcited by 79
  32. 2023Can GPT-4 Perform Neural Architecture Search?cited by 74
  33. 2023MathChat: Converse to Tackle Challenging Math Problems with LLM Agentscited by 67
  34. 2021Can We Automate Scientific Reviewing?cited by 63
  35. 2020ReviewRobot: Explainable Paper Review Generation based on Knowledge Synthesiscited by 53
  36. 2023Can Large Language Models Empower Molecular Property Prediction?cited by 43
  37. 2019Recent Advances in Neural Question Generationcited by 42
  38. 2023Are Large Language Models Ready for Healthcare? A Comparative Study on Clinical Language Understandingcited by 40

50 most cited of 72 All 72 (JSON)

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

  1. 2025Large language models for automated scholarly paper review: A surveycited by 59