# Rambler: Supporting Writing With Speech via LLM-Assisted Gist Manipulation

arXiv: https://arxiv.org/abs/2401.10838 · HTML: https://mlsanity.com/paper/2401.10838/

## Key facts

- Cited by 18 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 19 Jan 2024.

## Built on by (most cited first, 18 of 18)

- [How Far Are We From AGI: Are LLMs All We Need?](https://mlsanity.com/paper/2405.10313/) (2024)
- [Understanding the LLM-ification of CHI: Unpacking the Impact of LLMs at CHI through a Systematic Literature Review](https://mlsanity.com/paper/2501.12557/) (2025)
- [Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process](https://mlsanity.com/paper/2504.12488/) (2025)
- [Collage is the New Writing: Exploring the Fragmentation of Text and User Interfaces in AI Tools](https://mlsanity.com/paper/2405.17217/) (2024)
- ['Since Lawyers are Males..': Examining Implicit Gender Bias in Hindi Language Generation by LLMs](https://mlsanity.com/paper/2409.13484/) (2024)
- [Language Models as Critical Thinking Tools: A Case Study of Philosophers](https://mlsanity.com/paper/2404.04516/) (2024)
- [The Great AI Witch Hunt: Reviewers Perception and (Mis)Conception of Generative AI in Research Writing](https://mlsanity.com/paper/2407.12015/) (2024)
- [Semantic Commit: Helping Users Update Intent Specifications for AI Memory at Scale](https://mlsanity.com/paper/2504.09283/) (2025)
- [Content-Driven Local Response: Supporting Sentence-Level and Message-Level Mobile Email Replies With and Without AI](https://mlsanity.com/paper/2502.06430/) (2025)
- [PromptCanvas: Composable Prompting Workspaces Using Dynamic Widgets for Exploration and Iteration in Creative Writing](https://mlsanity.com/paper/2506.03741/) (2025)
- [From Voice to Value: Leveraging AI to Enhance Spoken Online Reviews on the Go](https://mlsanity.com/paper/2412.05445/) (2024)
- [Can LLMs Assist Annotators in Identifying Morality Frames? -- Case Study on Vaccination Debate on Social Media](https://mlsanity.com/paper/2502.01991/) (2025)
- [ChatGPT and U(X): A Rapid Review on Measuring the User Experience](https://mlsanity.com/paper/2503.15808/) (2025)
- [StepWrite: Adaptive Planning for Speech-Driven Text Generation](https://mlsanity.com/paper/2508.04011/) (2025)
- [AI Learning Algorithms: Deep Learning, Hybrid Models, and Large-Scale Model Integration](https://mlsanity.com/paper/2410.09186/) (2024)
- [Co-Writing with AI: An Empirical Study of Diverse Academic Writing Workflows](https://mlsanity.com/paper/2604.25389/) (2026)
- [Re-Sonance: A Dysarthric Asynchronous Real-Time Speech Conversion System Based on a Three-Stage Cascaded ASR-LLM-TTS Architecture](https://mlsanity.com/paper/2607.17615/) (2026)
- [Method, Mind, and Morality: How People Make Sense of Artificial Intelligence](https://mlsanity.com/paper/2608.24748/) (2026)

## Abstract (arXiv)

Dictation enables efficient text input on mobile devices. However, writing with speech can produce disfluent, wordy, and incoherent text and thus requires heavy post-processing. This paper presents Rambler, an LLM-powered graphical user interface that supports gist-level manipulation of dictated text with two main sets of functions: gist extraction and macro revision. Gist extraction generates keywords and summaries as anchors to support the review and interaction with spoken text. LLM-assisted macro revisions allow users to respeak, split, merge and transform dictated text without specifying precise editing locations. Together they pave the way for interactive dictation and revision that help close gaps between spontaneous spoken words and well-structured writing. In a comparative study with 12 participants performing verbal composition tasks, Rambler outperformed the baseline of a speech-to-text editor + ChatGPT, as it better facilitates iterative revisions with enhanced user control over the content while supporting surprisingly diverse user strategies.