HiCaM: A Hierarchical-Causal Modification Framework for Long-Form Text Modification
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) have achieved remarkable success in various domains. However, when handling long-form text modification tasks, they still face two major problems: (1) producing undesired modifications by inappropriately altering or summarizing irrelevant content, and (2) missing necessary modifications to implicitly related passages that are crucial for maintaining document coherence. To address these issues, we propose HiCaM, a Hierarchical-Causal Modification framework that operates through a hierarchical summary tree and a causal graph. Furthermore, to evaluate HiCaM, we derive a multi-domain dataset from various benchmarks, providing a resource for assessing its effectiveness. Comprehensive evaluations on the dataset demonstrate significant improvements over strong LLMs, with our method achieving up to a 79.50% win rate. These results highlight the comprehensiveness of our approach, showing consistent performance improvements across multiple models and domains.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 34 references that are in the map. First posted on arXiv 30 May 2025.
Builds on
22 of 34 references.
References · 22
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
- 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,378
- 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 793
- 2023Safe RLHF: Safe Reinforcement Learning from Human Feedbackcited by 630
- 2017The NarrativeQA Reading Comprehension Challengecited by 590
- 2021A Dataset of Information-Seeking Questions and Answers Anchored in Research Paperscited by 475
- 2021QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarizationcited by 363
- 2021Efficient Attentions for Long Document Summarizationcited by 342
- 2021QuALITY: Question Answering with Long Input Texts, Yes!cited by 204
- 2024LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMscited by 142
- 2020A Distributional Approach to Controlled Text Generationcited by 117
10 more
- 2024AutoSurvey: Large Language Models Can Automatically Write Surveyscited by 116
- 2023Controlled Text Generation with Natural Language Instructionscited by 87
- 2020PAIR: Planning and Iterative Refinement in Pre-trained Transformers for Long Text Generationcited by 35
- 2021Attribute Alignment: Controlling Text Generation from Pre-trained Language Modelscited by 27
- 2021Parallel Refinements for Lexically Constrained Text Generation with BARTcited by 24
- 2024Language Models can Self-Lengthen to Generate Long Textscited by 24
- 2022Controlled Text Generation using T5 based Encoder-Decoder Soft Prompt Tuning and Analysis of the Utility of Generated Text in AIcited by 6
- 2022PCFG-based Natural Language Interface Improves Generalization for Controlled Text Generationcited by 4
- 2023Controllable Generation of Dialogue Acts for Dialogue Systems via Few-Shot Response Generation and Rankingcited by 4
- 2024Harnessing the Plug-and-Play Controller by Promptingcited by 4
Built on by
Not cited yet.