Exploring Mobile Touch Interaction with Large Language Models
Not on the map. Why?
Abstract (arXiv)
Interacting with Large Language Models (LLMs) for text editing on mobile devices currently requires users to break out of their writing environment and switch to a conversational AI interface. In this paper, we propose to control the LLM via touch gestures performed directly on the text. We first chart a design space that covers fundamental touch input and text transformations. In this space, we then concretely explore two control mappings: spread-to-generate and pinch-to-shorten, with visual feedback loops. We evaluate this concept in a user study (N=14) that compares three feedback designs: no visualisation, text length indicator, and length + word indicator. The results demonstrate that touch-based control of LLMs is both feasible and user-friendly, with the length + word indicator proving most effective for managing text generation. This work lays the foundation for further research into gesture-based interaction with LLMs on touch devices.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 9 of its 58 references that are in the map. First posted on arXiv 11 Feb 2025.
Builds on
9 of 58 references.
References · 9
- 2024A Design Space for Intelligent and Interactive Writing Assistantscited by 76
- 2023Choice Over Control: How Users Write with Large Language Models using Diegetic and Non-Diegetic Promptingcited by 36
- 2023Writer-Defined AI Personas for On-Demand Feedback Generationcited by 36
- 2023DirectGPT: A Direct Manipulation Interface to Interact with Large Language Modelscited by 32
- 2022Interacting with next-phrase suggestions: How suggestion systems aid and influence the cognitive processes of writingcited by 27
- 2024Patchview: LLM-Powered Worldbuilding with Generative Dust and Magnet Visualizationcited by 23
- 2023From Text to Self: Users' Perceptions of Potential of AI on Interpersonal Communication and Selfcited by 18
- 2024Collage is the New Writing: Exploring the Fragmentation of Text and User Interfaces in AI Toolscited by 13
- 2022Suggestion Lists vs. Continuous Generation: Interaction Design for Writing with Generative Models on Mobile Devices Affect Text Length, Wording and Perceived Authorshipcited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Intelligent Interaction Techniques (IIxT) - Proposalcited by 0
- 2026Intelligent Interaction Techniques (IIxT) - Proposal14 Sep 2026