In-Place Feedback: Reliable Refinement for Multi-Turn Expert-LLM Collaboration
Not on the map. Why?
Abstract (arXiv)
LLM-generated drafts often contain subtle factual or logical errors, yet prior work shows that models struggle to reliably integrate multi-turn feedback aimed at fixing them. We propose in-place feedback, an interaction paradigm in which the user directly edits the model's previous response and the model continues generation from the edited context. In-place feedback consistently outperforms standard multi-turn feedback across five reasoning-intensive benchmarks while requiring fewer tokens, and our fine-grained analysis shows that it applies corrections more reliably and propagates them to subsequent reasoning. A user study with domain experts refining LLM-generated summaries corroborates these findings: participants report higher final-output satisfaction and substantially lower fatigue with in-place feedback, and a mixed strategy combining in-place and multi-turn feedback scores highest on every measured dimension. These results suggest that editing errors directly is a more effective paradigm for expert-LLM collaboration.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 42 references that are in the map. First posted on arXiv 1 Oct 2025.
Builds on
25 of 42 references.
References · 25
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 1,017
- 2022In-context Learning and Induction Headscited by 964
- 2025LLMs Get Lost In Multi-Turn Conversationcited by 429
- 2023MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedbackcited by 297
13 more
- 2022Generating Sequences by Learning to Self-Correctcited by 277
- 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 249
- 2024ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RLcited by 228
- 2025ZebraLogic: On the Scaling Limits of LLMs for Logical Reasoningcited by 201
- 2025MultiChallenge: A Realistic Multi-Turn Conversation Evaluation Benchmark Challenging to Frontier LLMscited by 180
- 2019Asking Clarifying Questions in Open-Domain Information-Seeking Conversationscited by 139
- 2025CollabLLM: From Passive Responders to Active Collaboratorscited by 124
- 2024Modeling Future Conversation Turns to Teach LLMs to Ask Clarifying Questionscited by 76
- 2024Multi-turn Reinforcement Learning from Preference Human Feedbackcited by 67
- 2025Answer Matching Outperforms Multiple Choice for Language Model Evaluationcited by 41
- 2024WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualizationcited by 39
- 2025Training Turn-by-Turn Verifiers for Dialogue Tutoring Agents: The Curious Case of LLMs as Your Coding Tutorscited by 20
- 2024Let the Code LLM Edit Itself When You Edit the Codecited by 10
Built on by
Citing papers per year: 2026: 1.
1 paper.