Think Before you Write: QA-Guided Reasoning for Character Descriptions in Books
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Character description generation is an important capability for narrative-focused applications such as summarization, story analysis, and character-driven simulations. However, generating accurate character descriptions from long-form narratives (e.g., novels) is challenging: models must track evolving attributes (e.g., relationships and events), integrate evidence scattered across the text, and infer implicit details. Despite the success of reasoning-enabled LLMs on many benchmarks, we find that for character description generation their performance improves when built-in reasoning is disabled (i.e., an empty reasoning trace). Motivated by this, we propose a training framework that decouples reasoning from generation. Our approach, which can be applied on top of long-context LLMs or chunk-based methods, consists of a reasoning model that produces a structured QA reasoning trace and a generation model that conditions on this trace to produce the final character description. Experiments on two datasets (BookWorm and CroSS) show that QA-guided reasoning improves faithfulness, informativeness, and grounding over strong long-context baselines.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 20 of its 65 references that are in the map. First posted on arXiv 13 Apr 2026.
Builds on
20 of 65 references.
Closest ancestors · 2
Same direction, newest first
- 2025Qwen3 Technical Report14 May
- 2025Learning to Reason for Long-Form Story Generation28 Mar
Other references · 18
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2025Gemma 3 Technical Reportcited by 1,686
- 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,057
- 2022Solving math word problems with process- and outcome-based feedbackcited by 871
- 2024LongRoPE: Extending LLM Context Window Beyond 2 Million Tokenscited by 302
- 2021Recursively Summarizing Books with Human Feedbackcited by 287
- 2024Long-context LLMs Struggle with Long In-context Learningcited by 285
- 2025Learning to Reason without External Rewardscited by 199
- 2023Retrieval meets Long Context Large Language Modelscited by 114
6 more
- 2023Execution-based Code Generation using Deep Reinforcement Learningcited by 95
- 2024OpenRLHF: An Easy-to-use, Scalable and High-performance RLHF Frameworkcited by 70
- 2024Challenges in Deploying Long-Context Transformers: A Theoretical Peak Performance Analysiscited by 44
- 2025BLEUBERI: BLEU is a surprisingly effective reward for instruction followingcited by 17
- 2025Savaal: Scalable Concept-Driven Question Generation to Enhance Human Learningcited by 7
- 2015Modeling Dynamic Relationships Between Characters in Literary Novelscited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024DetectiveQA: Evaluating Long-Context Reasoning on Detective Novels
- 2025PRELUDE: A Benchmark Designed to Require Global Comprehension and Reasoning over Long Contexts
- 2026Planning Beyond Text: Graph-based Reasoning for Complex Narrative Generation
- 2026Narrative Knowledge Weaver: Narrative-Centric Retrieval-Augmented Reasoning for Long-Form Text Understanding
- 2026StoryCoder: Narrative Reformulation for Structured Reasoning in LLM Code Generation
- 2024NovelQA: Benchmarking Question Answering on Documents Exceeding 200K Tokens
- 2025NovelHopQA: Diagnosing Multi-Hop Reasoning Failures in Long Narrative Contexts
- 2024Beyond Math: Stories as a Testbed for Memorization-Constrained Reasoning in LLMs