mlsanityData to 14 Oct 2026

PaperClaw: Harnessing Agents for Autonomous Research and Human-in-the-Loop Refinement

arXiv 2606.22610 ↗First posted 21 Jun 2026cs.AIcited by 1

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

Large language models have become capable reasoners and tool users that write and run code and search the literature, which makes automating the research process itself a realistic goal. We present PAPERCLAW, a harnessed multi-agent system that carries a project autonomously, from a field of study to a finished paper. PAPERCLAW curates a domain from a field's live literature, datasets, and code; brainstorms it into an idea with a pre-registered main-result contract; and drives a stoppable hypothesis map through an iterative propose, test, reflect loop that grows only from measured verdicts and halts once the evidence supports the idea, at which point it writes a venue-compliant paper. A full-lifecycle memory keeps each stage in a single living record, so a long run can be paused, inspected, and resumed without losing context. At the centre is an in-cycle research assistant with research tools and skills: it can drive the whole pipeline on its own, while the same interface lets a person step in at any stage, turning a first autonomous draft into a stronger paper through human-in-the-loop refinement. Throughout, PAPERCLAW keeps its output grounded and checkable, citing only references validated against open scholarly indexes and reporting results that genuinely ran. An evaluation with an LLM judge finds that PAPERCLAW produces strong papers both fully autonomously and with human-in-the-loop refinement.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 77 of its 85 references that are in the map. First posted on arXiv 21 Jun 2026.

Builds on

77 of 85 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Agent Laboratory: Using LLM Agents as Research Assistants8 Jan
  2. 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers6 Sep
  3. 2024DiscoveryBench: Towards Data-Driven Discovery with Large Language Models1 Jul
  4. 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentation5 Oct

Other references · 73

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2022Training language models to follow instructions with human feedbackcited by 15,971
  6. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  7. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  8. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  9. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  10. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  11. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  12. 2021Evaluating Large Language Models Trained on Codecited by 8,320
38 more
  1. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  2. 2020Scaling Laws for Neural Language Modelscited by 6,586
  3. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  4. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  5. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  6. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  7. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  8. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  9. 2021Program Synthesis with Large Language Modelscited by 3,637
  10. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  11. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  12. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  13. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  14. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  15. 2022Emergent Abilities of Large Language Modelscited by 2,512
  16. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  17. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  18. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  19. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  20. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  21. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
  22. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,998
  23. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  24. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  25. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
  26. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  27. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  28. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  29. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
  30. 2022Competition-Level Code Generation with AlphaCodecited by 1,462
  31. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
  32. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
  33. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
  34. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  35. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
  36. 2021Improving language models by retrieving from trillions of tokenscited by 1,293
  37. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
  38. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190

50 most cited of 73 All 73 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026ResearchClawBench: A Benchmark for End-to-End Autonomous Scientific Research
  2. 2026PARNESS: A Paper Harness for End-to-End Automated Scientific Research with Dynamic Workflows, Full-Text Indexing, and Cross-Run Knowledge Accumulation
  3. 2026NanoResearch: Co-Evolving Skills, Memory, and Policy for Personalized Research Automation
  4. 2025Paper2Agent: Reimagining Research Papers As Interactive and Reliable AI Agents
  5. 2026Towards End-to-End Automation of AI Research
  6. 2026AutoSci: A Memory-Centric Agentic System for the Full Scientific Research Lifecycle
  7. 2026AI-Supervisor: Autonomous AI Research Supervision via a Persistent Research World Model
  8. 2026EviGraph: Evidence-Guided Autonomous Research Agents