mlsanityData to 14 Oct 2026

Beyond the Chat: Executable and Verifiable Text-Editing with LLMs

arXiv 2309.15337 ↗First posted 27 Sep 2023cs.CL cs.HCcited by 35

Not on the map. Why?

Abstract (arXiv)

Conversational interfaces powered by Large Language Models (LLMs) have recently become a popular way to obtain feedback during document editing. However, standard chat-based conversational interfaces do not support transparency and verifiability of the editing changes that they suggest. To give the author more agency when editing with an LLM, we present InkSync, an editing interface that suggests executable edits directly within the document being edited. Because LLMs are known to introduce factual errors, Inksync also supports a 3-stage approach to mitigate this risk: Warn authors when a suggested edit introduces new information, help authors Verify the new information's accuracy through external search, and allow an auditor to perform an a-posteriori verification by Auditing the document via a trace of all auto-generated content. Two usability studies confirm the effectiveness of InkSync's components when compared to standard LLM-based chat interfaces, leading to more accurate, more efficient editing, and improved user experience.

Key facts. Cited by 35 papers in the map (data through 14 Oct 2026). Builds on 49 of its 115 references that are in the map. First posted on arXiv 27 Sep 2023.

Builds on

49 of 115 references.

References · 49

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  4. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
  5. 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 900
  6. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 894
  7. 2023Enabling Large Language Models to Generate Text with Citationscited by 595
  8. 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 407
  9. 2021A Survey on Automated Fact-Checkingcited by 378
  10. 2021Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translationcited by 338
  11. 2023Evaluating Verifiability in Generative Search Enginescited by 303
  12. 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 249
37 more
  1. 2021QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarizationcited by 236
  2. 2023Does Writing with Language Models Reduce Content Diversity?cited by 192
  3. 2022Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry Professionalscited by 191
  4. 2019Neural Text Summarization: A Critical Evaluationcited by 189
  5. 2021Annotating and Modeling Fine-grained Factuality in Summarizationcited by 131
  6. 2021A Recipe For Arbitrary Text Style Transfer with Large Language Modelscited by 107
  7. 2019Automatically Neutralizing Subjective Bias in Textcited by 105
  8. 2021Decontextualization: Making Sentences Stand-Alonecited by 102
  9. 2022Evaluating Human-Language Model Interactioncited by 92
  10. 2022PEER: A Collaborative Language Modelcited by 86
  11. 2021Sparks: Inspiration for Science Writing using Language Modelscited by 80
  12. 2022Help me write a poem: Instruction Tuning as a Vehicle for Collaborative Poetry Writingcited by 71
  13. 2023CoEdIT: Text Editing by Task-Specific Instruction Tuningcited by 68
  14. 2021The Impact of Multiple Parallel Phrase Suggestions on Email Input and Composition Behaviour of Native and Non-Native English Writerscited by 61
  15. 2022Understanding Iterative Revision from Human-Written Textcited by 57
  16. 2022LENS: A Learnable Evaluation Metric for Text Simplificationcited by 54
  17. 2022Read, Revise, Repeat: A System Demonstration for Human-in-the-loop Iterative Text Revisioncited by 46
  18. 2023Supporting Human-AI Collaboration in Auditing LLMs with LLMscited by 46
  19. 2021Keep it Simple: Unsupervised Simplification of Multi-Paragraph Textcited by 45
  20. 2021Wordcraft: a Human-AI Collaborative Editor for Story Writingcited by 41
  21. 2023LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyondcited by 38
  22. 2019Combating Fake News: A Survey on Identification and Mitigation Techniquescited by 33
  23. 2023Revisiting non-English Text Simplification: A Unified Multilingual Benchmarkcited by 27
  24. 2023LLMs as Workers in Human-Computational Algorithms? Replicating Crowdsourcing Pipelines with LLMscited by 27
  25. 2023How Do Analysts Understand and Verify AI-Assisted Data Analyses?cited by 26
  26. 2022Threddy: An Interactive System for Personalized Thread-based Exploration and Organization of Scientific Literaturecited by 22
  27. 2023The AI Ghostwriter Effect: When Users Do Not Perceive Ownership of AI-Generated Text But Self-Declare as Authorscited by 22
  28. 2023Beyond Summarization: Designing AI Support for Real-World Expository Writing Taskscited by 20
  29. 2023Next Steps for Human-Centered Generative AI: A Technical Perspectivecited by 13
  30. 2023SWiPE: A Dataset for Document-Level Simplification of Wikipedia Pagescited by 12
  31. 2023Comparing Sentence-Level Suggestions to Message-Level Suggestions in AI-Mediated Communicationcited by 9
  32. 2022Suggestion Lists vs. Continuous Generation: Interaction Design for Writing with Generative Models on Mobile Devices Affect Text Length, Wording and Perceived Authorshipcited by 7
  33. 2023Parachute: Evaluating Interactive Human-LM Co-writing Systemscited by 7
  34. 2020Characterizing Stage-Aware Writing Assistance in Collaborative Document Authoringcited by 6
  35. 2022Identifying Ethical Issues in AI Partners in Human-AI Co-Creationcited by 5
  36. 2022The Case for a Single Model that can Both Generate Continuations and Fill in the Blankcited by 2
  37. 2023Repurposing Text-Generating AI into a Thought-Provoking Writing Tutorcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 8; 2025: 15; 2026: 12.

35 papers.

Sort:

By area:

  1. 2024Can AI writing be salvaged? Mitigating Idiosyncrasies and Improving Human-AI Alignment in the Writing Process through Editscited by 49
  2. 2025AI-Slop to AI-Polish? Aligning Language Models through Edit-Based Writing Rewards and Test-time Computationcited by 25
  3. 2024The Impossibility of Fair LLMscited by 22
  4. 2025Is Your Paper Being Reviewed by an LLM? Benchmarking AI Text Detection in Peer Reviewcited by 21
  5. 2025Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Processcited by 14
  6. 2024mEdIT: Multilingual Text Editing via Instruction Tuningcited by 13
  7. 2025Help Me Write a Story: Evaluating LLMs' Ability to Generate Writing Feedbackcited by 11
  8. 2025Evaluating the Sensitivity of LLMs to Prior Contextcited by 9
  9. 2024Steering AI-Driven Personalization of Scientific Text for General Audiencescited by 7
  10. 2025OnGoal: Tracking and Visualizing Conversational Goals in Multi-Turn Dialogue with Large Language Modelscited by 7
  11. 2024Large Language Models Meet User Interfaces: The Case of Provisioning Feedbackcited by 4
  12. 2024Spivavtor: An Instruction Tuned Ukrainian Text Editing Modelcited by 4
23 more
  1. 2025HealthGenie: Empowering Users with Healthy Dietary Guidance through Knowledge Graph and Large Language Modelscited by 4
  2. 2025HyperEdit: Unlocking Instruction-based Text Editing in LLMs via Hypernetworkscited by 4
  3. 2025Semantic Commit: Helping Users Update Intent Specifications for AI Memory at Scalecited by 3
  4. 2025Attribution Gradients: Incrementally Unfolding Citations for Critical Examination of Attributed AI Answerscited by 3
  5. 2024Large Language Models are Pattern Matchers: Editing Semi-Structured and Structured Documents with ChatGPTcited by 2
  6. 2024SummExecEdit: A Factual Consistency Benchmark in Summarization with Executable Editscited by 1
  7. 2025Comparing Native and Non-native English Speakers' Behaviors in Collaborative Writing through Visual Analyticscited by 1
  8. 2025RevTogether: Supporting Science Story Revision with Multiple AI Agentscited by 1
  9. 2025CHOIR: A Chatbot-mediated Organizational Memory Leveraging Communication in University Research Labscited by 1
  10. 2026CoLyricist: Enhancing Lyric Writing with AI through Workflow-Aligned Supportcited by 1
  11. 2026Beyond the Desk: Barriers and Future Opportunities for AI to Assist Scientists in Embodied Physical Taskscited by 1
  12. 2026Priming, Path-dependence, and Plasticity: Understanding the molding of user-LLM interaction and its implications from (many) chat logs in the wildcited by 1
  13. 2026How to Ask the AI: A User Perspective Survey for Large Language Model Promptingcited by 1
  14. 2025Voice Interaction With Conversational AI Could Facilitate Thoughtful Reflection and Substantive Revision in Writingcited by 0
  15. 2025Componentization: Decomposing Monolithic LLM Responses into Manipulable Semantic Unitscited by 0
  16. 2026From Binary Groundedness to Support Relations: Towards a Reader-Centred Taxonomy for Comprehension of AI Outputcited by 0
  17. 2026U-Define: Designing User Workflows for Hard and Soft Constraints in LLM-Based Planningcited by 0
  18. 2026StagedWorkspace: A Versioned Workspace for Knowledge-Work Agentscited by 0
  19. 2026Towards Cognitive Process-Aware Proactive Writing Supportcited by 0
  20. 2026RecalibrateGPT: AI Fatigue Resilient Conversational Interfacescited by 0
  21. 2026Beyond "ChatGPT Can Make Mistakes": Designing Interventions to Support Metacognitive Monitoring in AI-Assisted Workcited by 0
  22. 2026DocuTeam: Mixed-Initiative Multi-Agent Discussions around Evolving Documentscited by 0
  23. 2026NarrativeSteward: Coordinating Delegation, Guidance, and Verification in Agent-Assisted Interactive Narrative Authoringcited by 0