Internalizing Academic Writing Workflows for Introduction Generation via Struct-Aware Policy Learning
Not on the map. Why?
Abstract (arXiv)
Generating a rigorous paper introduction with large language models (LLMs) remains challenging, since it requires coordinating background, gap identification, method and contribution within a coherent narrative. Existing solutions externalize this process as multi-stage prompts or agent workflows which are expensive and vulnerable to cross-stage drift. We propose StructPO, a struct-aware policy learning framework that internalizes the entire multi-stage writing workflow into a single-pass policy controlled by explicit stage tokens. StructPO introduces struct-aware credit assignment to decouple local stage quality from global coherence and refinement-guided optimization to internalize revision behavior into the first-pass policy. Experiments show that StructPO improves semantic alignment, structural rationality and inference efficiency over workflow-based baselines, generalizes to out-of-domain settings, and remains competitive with GPT-5.1 in human evaluation when scaled to Qwen3-32B. These results show that internalizing academic writing workflows through fine-grained policy optimization offers a viable alternative to costly external orchestration.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 63 references that are in the map. First posted on arXiv 4 Aug 2026.
Builds on
25 of 63 references.
References · 25
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,141
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 497
- 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 425
13 more
- 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 267
- 2024Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agentscited by 97
- 2024LitLLM: A Toolkit for Scientific Literature Reviewcited by 63
- 2025SurveyForge: On the Outline Heuristics, Memory-Driven Generation, and Multi-dimensional Evaluation for Automated Survey Writingcited by 49
- 2025Information Gain-based Policy Optimization: A Simple and Effective Approach for Multi-Turn Search Agentscited by 48
- 2024SciLitLLM: How to Adapt LLMs for Scientific Literature Understandingcited by 29
- 2025A Vision for Auto Research with LLM Agentscited by 18
- 2025AbGen: Evaluating Large Language Models in Ablation Study Design and Evaluation for Scientific Researchcited by 13
- 2025Self-Guided Process Reward Optimization with Redefined Step-wise Advantage for Process Reinforcement Learningcited by 11
- 2025SpeechFake: A Large-Scale Multilingual Speech Deepfake Dataset Incorporating Cutting-Edge Generation Methodscited by 7
- 2026SketchVL: Policy Optimization via Fine-Grained Credit Assignment for Chart Understanding and Morecited by 7
- 2025Towards AI-Assisted Research Writing: Benchmarking LLMs for AI/ML Introduction Generationcited by 6
- 2025Eliminating Agentic Workflow for Introduction Generation with Parametric Stage Tokenscited by 1
Built on by
Not cited yet.