mlsanityData to 14 Oct 2026

ConvergeWriter: Data-Driven Bottom-Up Article Construction

arXiv 2509.12811 ↗First posted 16 Sep 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) have shown remarkable prowess in text generation, yet producing long-form, factual documents grounded in extensive external knowledge bases remains a significant challenge. Existing "top-down" methods, which first generate a hypothesis or outline and then retrieve evidence, often suffer from a disconnect between the model's plan and the available knowledge, leading to content fragmentation and factual inaccuracies. To address these limitations, we propose a novel "bottom-up," data-driven framework that inverts the conventional generation pipeline. Our approach is predicated on a "Retrieval-First for Knowledge, Clustering for Structure" strategy, which first establishes the "knowledge boundaries" of the source corpus before any generative planning occurs. Specifically, we perform exhaustive iterative retrieval from the knowledge base and then employ an unsupervised clustering algorithm to organize the retrieved documents into distinct "knowledge clusters." These clusters form an objective, data-driven foundation that directly guides the subsequent generation of a hierarchical outline and the final document content. This bottom-up process ensures that the generated text is strictly constrained by and fully traceable to the source material, proactively adapting to the finite scope of the knowledge base and fundamentally mitigating the risk of hallucination. Experimental results on both 14B and 32B parameter models demonstrate that our method achieves performance comparable to or exceeding state-of-the-art baselines, and is expected to demonstrate unique advantages in knowledge-constrained scenarios that demand high fidelity and structural coherence. Our work presents an effective paradigm for generating reliable, structured, long-form documents, paving the way for more robust LLM applications in high-stakes, knowledge-intensive domains.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 28 references that are in the map. First posted on arXiv 16 Sep 2025.

Builds on

15 of 28 references.

References · 15

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  3. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  4. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
  5. 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 532
  6. 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 335
  7. 2024Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Modelscited by 154
  8. 2024LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMscited by 144
  9. 2024Language agents achieve superhuman synthesis of scientific knowledgecited by 137
  10. 2024AutoSurvey: Large Language Models Can Automatically Write Surveyscited by 119
  11. 2025A Survey of Large Language Model Agents for Question Answeringcited by 48
  12. 2024Into the Unknown Unknowns: Engaged Human Learning through Participation in Language Model Agent Conversationscited by 43
3 more
  1. 2025OmniThink: Expanding Knowledge Boundaries in Machine Writing through Thinkingcited by 18
  2. 2024AutoPatent: A Multi-Agent Framework for Automatic Patent Generationcited by 16
  3. 2025A Cognitive Writing Perspective for Constrained Long-Form Text Generationcited by 14

Built on by

Not cited yet.