mlsanityData to 7 Oct 2026

GEIS: A Generation-Evaluation-Improvement Loop of Agent Skills for Long-Form Article Generation

arXiv 2607.11503 ↗First posted 13 Jul 2026cs.CLcited by 0

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

Long-form article generation remains difficult for large language models because it combines long context, long instructions, and long outputs. Existing multi-agent pipelines such as STORM improve information coverage by simulating role-specialized agents, but their capabilities are often entangled in prompts and fixed procedures, making them hard to inspect, reuse, or iteratively improve. This paper presents GEIS (Generation-Evaluation-Improvement loop of agent Skills), a loop of named and declarative skills for Wikipedia-style long-form article generation. Implemented and evaluated in Tasi Harness, GEIS composes skills for article writing, browser-based evidence and image collection, diagram rendering, PDF-aware pairwise evaluation, and rule-level skill improvement. Its core writing skill follows Request, Plan, Draft, Audit, Refine, and Deliver; the pairwise evaluation skill produces structured quality reports; and the improvement skill maps recurrent findings into permanent patches to the writing skill in our 20-topic experiment. We evaluate GEIS on 20 Wikipedia Featured Article topics. Under the same generation backend, GEIS improves over the Tasi Harness default writer by 8.0 points on a 100-point PDF quality rubric and outperforms STORM on the two comparable writing dimensions, structural quality and content quality. In the 20-topic improvement experiment, the patched writing skill raises the average score from 82.90 to 86.95, with 17 out of 20 topics improved and the gain mainly coming from content quality. These results show that long-form generation can be reframed from a fixed workflow into an inspectable, modular, and evaluation-guided improvement loop.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 20 of its 25 references that are in the map. First posted on arXiv 13 Jul 2026.

Builds on

20 of 25 references.

References · 20

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  5. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  6. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  7. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  8. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  9. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  10. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  11. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
  12. 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learningcited by 252
8 more
  1. 2024Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Modelscited by 150
  2. 2024LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMscited by 142
  3. 2025CollabLLM: From Passive Responders to Active Collaboratorscited by 117
  4. 2022PEER: A Collaborative Language Modelcited by 86
  5. 2024LongGenBench: Benchmarking Long-Form Generation in Long Context LLMscited by 47
  6. 2026Skill-R1: Agent Skill Evolution via Reinforcement Learningcited by 12
  7. 2024An Empirical Study of Retrieval Augmented Generation with Chain-of-Thoughtcited by 6
  8. 2025Improving End-to-End Training of Retrieval-Augmented Generation Models via Joint Stochastic Approximationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Wiki Live Challenge: Challenging Deep Research Agents with Expert-Level Wikipedia Articles
  2. 2025RAPID: Efficient Retrieval-Augmented Long Text Generation with Writing Planning and Information Discovery
  3. 2026Wyvern: An Agentic Framework for Generating Grounded Multimodal Reports
  4. 2024Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agents
  5. 2026An Agentic Hybrid Top-Down and Bottom-Up Approach to Knowledge Graph Generation
  6. 2025AgentEval: Generative Agents as Reliable Proxies for Human Evaluation of AI-Generated Content
  7. 2025SuperWriter: Reflection-Driven Long-Form Generation with Large Language Models
  8. 2024WIKIGENBENCH: Exploring Full-length Wikipedia Generation under Real-World Scenario